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ABSTRACT 


This  research  will  first  examine  the  historical  role  of  the  United  States  Naval 
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will  be  illustrated  to  provide  an  understanding  of  the  framework  in  which  the 
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performance  measiu'ement  as  a  tool  for  improvement  will  then  be  examined  in  terms 
of  the  mission  of  the  academy  and  role  of  the  company  officer.  This  research  will  then 
examine  the  current  performance  measurement  methods  employed  by  Company 
Officers  at  the  United  States  Naval  Academy  and  how  these  methods  factor  into 
improved  midshipman  leadership  development.  Research  will  include  conducting  a 
detailed  analysis  of  the  role  of  the  company  officer  in  midshipman  leadership 
development.  Data  will  be  collected  and  analyzed  using  a  performance  measurement 
approach.  The  results  of  this  analysis  will  enable  company  officers  to  develop  new 
measurement  ideas  with  the  focus  on  improving  the  midshipmen  leadership 
development  process. 


VI 


TABLE  OF  CONTENTS 


L  INTRODUCTION _ 1 

A.  BACKGROUND . 1 

B.  PURPOSE . 2 

C.  SCOPE  AND  METHODOLOGY . 3 

D.  ORGANIZATION  OF  STUDY . 4 

1.  Introduction . . . 4 

2.  Literature  Review . 5 

3 .  Overview  of  Current  Practices . 5 

4.  Analysis  of  Data . 6 

5.  Summary,  Conclusions,  and  Recommendations . 7 

n.  LITERATURE  RE  VIEW - 9 

A.  HISTORICAL  PERSPECTIVE . . . 9 

1 .  United  States  Naval  Academy . 9 

a) Formation . 9 

b) Purpose . 12 

c) Configuration . 12 

d) Role  of  Company  Officer . 16 

B.  LEADERSHIP .  18 

C.  PERFORMANCE  MANAGEMENT . 21 

1 .  Performance  Measurement  in  Education . 22 

vii 


2. 


Performance  Measurement  in  the  Department  of  Defense 


23 


3 .  Performance  Measurement  Approaches . 25 

4.  The  Measurement  Linkage  Model . 26 

m.  OVERVIEW  OF  CURRENT  PRACTICES - 31 

A.  THE  MEASURES . 31 

B.  THE  DATA . 35 

IV.  DATA  ANALYSIS - 41 

A.  GENERATION  OF  CRITERIA . 41 

B.  KEY  INDICATOR  ANALYSIS . 45 

C.  OPERATIONAL  USE . 59 

V.  SUMMARY,  CONCLUSION,  AND  RECOMMENDATIONS - 69 

A.  SUMMARY . 69 

B.  CONCLUSION . 70 

C.  RECOMMENDATIONS . 73 

1 .  For  the  Naval  Academy . 73 

2.  For  further  research . 74 

REFERENCES _ 77 

INITIAL  DISTRIBUTION  LIST - 81 


vin 


L  INTRODUCTION 


A.  BACKGROUND 

The  United  States  Naval  Academy  has  evolved  over  one  hundred  and  fifty-three 
years.  It  started  as  a  Naval  School  whose  primary  function  was  to  educate  potential 
officers  in  the  basics  of  contemporary  subjects.  These  subjects  included  English, 
arithmetic,  algebra,  geometry,  navigation,  geography,  nautical  astronomy,  French, 
Spanish,  mechanics,  magnetism,  electricity,  ordnance,  gunnery,  the  use  of  steam,  and 
history  (Sturdy,  1935).  Leadership  was  not  taught  as  a  subject.  Midshipmen  leadership 
skills  were  learned  by  example  and  through  ejqjosure  to  commissioned  officers.  The 
Naval  Academy  has  evolved  into  a  modem  university  where  many  majors  are  offered  and 
leadership  is  consciously  learned  through  study  as  a  subject  and  practical  application  in 
the  midshipmen  run  regiment. 

Performance  management  and  measurement  in  modem  business  began  over  fifty 
years  ago.  Recently  local  govenunents  have  been  implementing  both  at  an  unprecedented 
rate.  The  federal  government  has  also  moved  to  implement  mandatory  performance 
measurement  with  the  Government  Performance  and  Results  Act  of  1993  (Public  law 
103-62).  This  law  requires  Federal  agencies  to  develop  strategic  plans  for  how  they 
deliver  high  quality  goods  and  services  to  the  American  public.  These  strategic  plans  will 
be  the  starting  point  for  each  Federal  agency  to  establish  agency  goals  and  objectives, 
define  how  it  will  achieve  those  goals,  and  then  measure  whether  or  not  those  goals  were 
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met  (National  Public  Review,  1997).  The  purpose  behind  this  is  using  measurement 
feedback  for  process  improvement. 

B.  PURPOSE 

The  purpose  of  the  Naval  Academy  is  to  develop  the  professional  capabilities  and 
leadership  abilities  of  the  midshipmen  in  preparation  for  the  fleet.  The  impact  that  the 
company  officer  has  upon  this  development  is  immeasurable.  Developing  leadership 
ability  in  midshipmen  implies  a  process  of  evaluation,  feedback  and  continuous 
improvement.  Performance  management  and  performance  measurement  provide  the 
necessary  framework  for  analyzing  current  performance  with  the  goal  of  improvement. 
Developing  midshipmen  and  junior  officers  in  the  practical  application  of  performance 
measurement  techniques  provides  a  leadership  and  management  tool  that  can  be  applied 
their  entire  career.  The  purpose  of  this  study,  titled  P erfotTnance  jnectsuvenicnt  for  the 
Compare  Officer:  An  examination  of  current  methods  used  at  the  United  States  Naval 
Academy,  is  to  examine  the  measures  currently  being  used  by  company  officers  to  gauge 
company  performance.  Those  measures  will  then  be  evaluated  using  Chang  and  De 
Young’s  Mftasiiring  organizational  improvement  impact  (1995)  as  a  performance 
measurement  standard.  This  process  of  examining  and  evaluating  the  measures  of  current 
company  officers  could  eventually  lead  to  a  basic  system  that  complements  the  personal 
leadership  style  of  the  company  officer. 
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C.  SCOPE  AND  METHODOLOGY 

Performance  measurement  for  the  Company  Officer:  An  examination  of  current 
methods  used  at  the  United  States  Naval  Academy  will  begin  with  a  historical  review  of 
the  mission  of  the  Naval  Academy  and  company  officer  role  in  that  mission.  This  will  be 
accomplished  by  conducting  a  literature  review  of  Naval  Academy  archives,  books, 
magazines  articles,  and  other  library  information  resources.  This  historical  review  will 
examine  the  history  behind  the  organization  and  mission  statements  of  the  Naval 
Academy.  It  will  illustrate  the  evolution  of  professional  and  leadership  development  at 
the  United  States  Naval  Academy.  A  literature  review  of  performance  management  and 
performance  measurement  including  previous  performance  measurement  research  done 
in  the  military  will  follow.  This  literature  review  will  also  examine  the  use  of 
performance  measurement  as  a  tool  of  leadership  in  leadership  development.  The 
performance  measures  used  by  Company  Officers  during  the  1997-1998  academic  year 
will  be  obtained  through  the  use  of  a  pre-interview  questionnaire  followed  by  personal 
interviews.  Analysis  of  current  performance  measurement  methods  and  tools  used  at  the 
Naval  Academy  will  use  Chang  and  DeYoung’s  Measuring  organizational  impact  (1995) 
as  a  performance  measurement  standard.  An  evaluation  of  these  measures  as  well  as  tools 
for  improving  leadership  development  will  follow  the  analysis.  The  thesis  will  conclude 
with  a  recommendation  for  implementing  the  successful  performance  monitoring 
techniques  used  by  company  officers. 
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D.  ORGANIZATION  OF  STUDY 

Performance  measurement  for  the  Company  Officer:  An  examination  of  current 

methods  used  at  the  United  States  Naval  Academy  is  organized  into  seven  chapters.  This 
section  will  briefly  outline  the  contents  of  each  chapter. 

1.  Introduction 

The  introduction  consists  of  a  background,  purpose,  scope  and  methodology, 
and  organization  of  study.  The  background  briefly  examines  the  mission  of  the  Naval 
Academy  and  its  evolution  over  one  hundred  and  fifl;y-three  years  from  a  trade  school  to 
a  university.  It  gives  an  overview  of  the  effect  of  that  evolution  on  the  mission  and  on 
leadership  development  in  the  midshipmen.  It  also  introduces  performance  management 
and  measurement  as  a  tool  of  good  leaders  and  suggests  its  applicability  to  the  mission  of 
the  Naval  Academy. 

The  purpose  will  elaborate  on  the  specific  applicability  of  performance 
measurement  to  the  company  officers  of  the  United  States  Naval  Academy  and  introduce 
the  topic  of  the  study  which  is  Performance  measurement  for  the  Compare  Officer:  An 
examination  of  current  methods  used  at  the  United  States  Naval  Academy.  It  also 
suggests  future  benefits  of  this  study,  which  could  be  a  performance  measurement 
system,  based  on  the  successful  measures  noted  in  this  study. 

The  scope  and  methodology  discusses  the  boundaries  of  the  study  and  the 
process  by  which  this  report  was  completed.  It  illustrates  the  research  method,  the  topics 
to  be  researched,  and  what  is  to  be  gained  by  conducting  this  research.  The  organization 
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of  study  outlines  each  chapter's  applicability  to  the  research  and  shows  the  contribution 
of  each  to  the  entire  study. 

2.  Literature  Review 

The  literature  review  will  examine  previous  research  on  the  topics  of  performance 
management  and  measurement;  leadership  and  leadership  development;  and  the  history 
of  the  Naval  Academy.  Specific  attention  will  be  devoted  to  the  effect  of  the  Naval 
Academy's  formation,  purpose,  and  configuration  on  the  evolution  of  the  company  officer 
and  consequently  how  the  leadership  development  of  the  midshipmen  has  progressed. 

The  literature  review  will  illustrate,  using  previous  research,  the  connection  between 
leadership  development,  performance  measurement,  and  the  United  States  Naval 
Academy.  This  will  answer  the  following  research  questions;  (1)  what  is  the  historical 
role  of  the  Naval  Academy  in  developing  leadership  in  midshipmen?  (2)  How  is  the 
Naval  Academy  organized  with  respect  to  leadership  development?  (3)  What  is 
performance  management?  (4)  What  is  performance  measurement?  (5)  How  does 
performance  measurement  contribute  to  leadership  development?  (6)  What  previous 
research  has  been  done  in  the  area  of  performance  measurement  as  it  relates  to  military 
academic  environments? 

3.  Overview  of  Current  Practices 

This  chapter  is  the  result  of  interviews  with  current  company  officers  and  will 
illustrate  the  measures  used  by  them  during  the  1997-1998  Academic  year.  The 
interviews  are  the  result  of  a  previous  project  that  generated  sixteen  measures  used  by 
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company  officers.  The  information  from  these  early  interviews  was  used  to  design  a  pre¬ 
interview  sheet  whose  purpose  was  three-fold.  The  pre-interview  sheet  was  designed  to 
illustrate  the  purpose  of  the  upcoming  interview,  provoke  thought,  and  streamline  the 
interview  to  maximize  the  number  to  be  completed. 

Each  measure  is  explained  in  detail  to  provide  an  imderstanding  of  the  potential 
usefulness  as  a  measure.  Data  will  be  displayed  in  bar  graph  form  illustrating  the 
measures  and  how  many  company  officers  use  them  out  of  the  total. 

4.  Analysis  of  Data 

This  chapter  will  expand  on  the  findings  presented  in  the  previous  chapter.  It  will 
discuss  each  performance  measure  in  more  detail  and  some  of  the  ways  the  measures 
were  actually  used.  It  is  one  thing  to  monitor  an  actual  measure,  and  it  is  entirely  different 
to  use  that  measure  in  a  true  performance  management  sense.  This  chapter  uses  Chang 
and  DeYoimg’s  Measuring  organizational  impact  (1995)  as  a  performance  measurement 
standard. 

Criteria  are  generated  from  the  Measurement  Linkage  Model  of  Chang  & 
DeYoimg  for  use  as  a  performance  measurement  standard.  These  criteria  determine 
which,  if  any,  of  the  sixteen  measures  currently  used  are  valid  key  indicators.  The 
measures  determined  to  be  valid  key  indicators  will  then  be  operationally  analyzed  to  see 
if  they  are  true  performance  measures  being  used  in  a  performance  management  system. 


5.  Summary,  Conclusions,  and  Recommendations 

This  chapter  has  three  sequential  parts;  a  summary,  conclusion,  and 
recommendations.  Each  part  contributes  to  the  chapter  in  the  following  way. 

The  sumihary  reviews  the  literature  review’s  historical  evolution  of  the  Company 
Officer  and  the  need  for  performance  measurement  at  the  Naval  Academy.  It  also 
summarizes  the  research  findings  and  places  them  in  perspective  relative  to  the  company 
officer  mission  of  leadership  development  in  midshipmen. 

The  conclusion  attempts  to  explain  the  research  findings.  The  results  of  the  study 
are  examined  and  reasons  postulated  for  those  results.  Another  study  is  referenced  to 
support  the  conclusions  drawn  fi-om  this  examination. 

The  recommendations  are  explained  in  two  parts.  There  are  recommendations 
specific  to  the  Naval  Academy  and  recommendations  for  further  research. 
Recommendations  for  the  Naval  Academy  uses  the  summary  and  the  conclusions  to 
suggest  specific  things  to  be  done  to  improve  the  use  of  performance  measurement  at  the 
Naval  Academy. 

Recommendations  for  further  research  highlight  the  limitations  of  the  study  and 
suggest  new  areas  for  further  study.  Examining  performance  measures  used  during  one 
academic  year,  during  the  term  of  only  one  Commandant  is  one  such  limitation.  Problems 
that  arose  during  the  thesis  will  be  discussed  as  well  as  possible  solutions  to  those 
problems  for  a  future  study.  Performance  measures  have  limitations  which  company 
officers  need  to  remember.  This  chapter  will  briefly  discuss  them. 
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n.  LITERATURE  REVIEW 


A.  fflSTORICAL  PERSPECTIVE 

The  United  States  Naval  Academy  has  been  producing  Naval  Officers  for  over  one 
hundred  and  fifty  years.  The  Naval  Academy  process  of  midshipman  leadership  development  has 
evolved  throughout  a  centuiy  and  a  half  of  changes.  When  the  Naval  School  began,  leadership 
was  learned  by  example.  The  example  was  set  by  the  Commandant  and  other  officers.  Today,  it 
is  acquired  by  academic  and  professional  courses,  and  practical  experience  gained  in  the 
midshipmen  run  brigade. 

As  the  size  and  complexity  of  the  Naval  Academy  has  grown  the  Commandant's  role  as 
direct  mentor  has  been  replaced  by  the  Company  Officer.  This  makes  the  Company  Officer 
crucial  to  the  growth  of  midshipmen  into  Naval  Officers.  The  evolution  of  the  Company  Officer 
position  has  had  a  large  impact  on  the  development  of  future  Naval  Officers.  To  understand  this 
impact  it  is  necessary  to  examine  the  changing  role  of  the  Company  Officer  within  the  brigade. 

1.  United  States  Naval  Academy 
a)  Formation 

The  necessity  of  a  school  to  train  naval  officers  was  known  long  before  the  Naval 
Academy  became  a  reality.  In  1800,  Alexander  Hamilton,  then  the  Inspector  General  of  the 
Army,  first  proposed  a  military  academy  composed  of  four  schools.  The  planned  Military 
Academy  would  have  a  Fundamental  School,  School  of  Engineers  and  Artillerists,  School  of 
Cavalry  and  Infantry,  and  a  School  of  the  Navy  (Marshall,  1862).  In  1802,  Congress  passed  an 
act  which  did  organize  a  Military  Academy  at  West  Point,  New  York  but  failed  to  include  the 
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Naval  School  and  the  School  of  Cavalry  and  Infantry.  Naval  Officers  would  continue  to  obtain  a 
commission  through  examination  from  the  ranks  of  self-taught,  sea-assigned,  politically 
appointed  midshipmen. 

Naval  Regulations  were  issued  in  1802,  which  assigned  no  real  duties  to  the 
midshipmen.  They  were  "to  employ  a  due  portion  of  their  time  in  the  study  of  naval  tactics,  and 
in  acquiring  a  thorough  and  extensive  knowledge  of  all  the  various  duties  to  be  performed  on 
board  of  a  ship  of  war"  (Soley,  1876,  p.8).  These  regulations  left  the  schooling  to 
"schoolmasters"  who  did  not  even  exist  in  the  Navy  until  1813.  This  oversight  seems  to  be  the 
result  of  the  influence  of  the  English  "Regulations  and  Instructions  Relating  to  His  Majesty's 
Service  at  Sea"  (1734),  which  did  provide  for  qualified-by-examination  schoolmasters  on 
F.nglish  ships.  Since  there  were  no  schoolmasters  provided  for  in  the  original  1802  bill,  the  task 
of  instructing  future  naval  officers  in  writing,  arithmetic,  and  navigation  fell  to  the  Chaplains. 

The  Chaplains  were  anything  but  qualified  to  teach  these  subjects.  There  was  no  exam  or  other 
test  of  the  Chaplain's  ability  to  teach  these  subjects  and  "it  was  only  in  cases  of  fortunate  accident 
that  they  knew  anything  about  the  subject  before  they  were  called  to  teach  it"  (Soley,  1876, 
p.  10).  The  regard  for  the  Navy  at  that  time  is  illustrated  by  the  fact  that  the  country  would  pay  a 
greater  amoimt  to  the  B^ary  Powers  in  the  form  of  tribute  rather  than  spend  a  reasonable 
amovmt  in  the  building  of  frigates. 

Forty-two  years  later,  then  Secretary  of  the  Navy  George  Bancroft  realized  what 
all  the  previous  Navy  Secretaries,  Naval  Officers,  and  Congressmen  had  not;  that  he  had  all  the 
power  and  finances  needed,  without  Congressional  approval,  to  begin  operation  of  a  consolidated 
Naval  School.  It  could  be  done  by  merely  merging  the  teaching  assets  already  available  in  the 
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Navy  but  dispersed  in  New  York,  Boston,  Norfolk,  Philadelphia  and  at  sea.  He  obtained  Fort 
Severn  from  the  Secretary  of  War  and  the  Naval  School  was  bom  in  1845. 

Bancroft’s  original  Naval  School  was  essentially  a  trade  school,  designed  merely 
to  improve  the  management  of  the  assets  available  to  the  Navy  at  that  time.  Its  purpose  was  to 
better  concentrate  the  midshipmen  focus  on  formal  learning  rather  than  informal  sea  training. 
Thus,  midshipmen  would  be  better  educated  through  greater  standardization  in  the  training 
regimen  prior  to  commissioning.  The  midshipmen  still  had  to  go  to  sea  and  obtain  schooling  as 
time  ashore  at  the  Naval  School  permitted.  These  problems  are  best  illustrated  in  a  letter  of 
August  7*,  1845  from  George  Bancroft  to  the  first  Superintendent,  Commander  Franklin 
Buchanan  which  states; 

Thus  the  means  for  a  good  Naval  School  are  abundant,  though  they  have 
not  yet  been  collected  together  and  applied... One  great  difficulty  remains  to  be 
considered.  At  our  colleges  and  at  West  Point,  young  men  are  trained  in  a  series 
of  consecutive  years;  the  laws  of  the  United  States  do  not  sanction  a  preliminary 
school  for  the  navy;  they  only  provide  for  the  instruction  of  officers  who  are 
already  in  the  navy.  The  pupils  of  the  naval  school  being,  therefore,  officers  in  the 
public  service,  will  be  liable  at  all  times  to  be  called  from  their  studies,  and  sent 
on  public  duty.  Nfidshipmen,  too,  on  their  return  from  the  sea,  at  whatever  season 
of  the  year,  will  be  sent  to  the  school.  Under  these  circumstances,  you  will  be 
obliged  to  arrange  your  classes  in  such  a  manner  as  will  leave  opportunity  for 
those  who  arrive,  to  be  attached  to  classes  suited  to  the  stage  of  their  progress  in 
their  studies.  (Marshall,  1862,  pp.22-23) 

In  1850  Congress  authorized  a  regularly  prescribed  course  of  continuous 

instruction  and  changed  the  name  to  the  Naval  Academy  (Sturdy,  1935).  In  1851  the  school 

curriculum  was  changed  to  four  consecutive  years  at  the  Academy  with  summer  practice  cruises. 

In  review.  Officer  training  began  after  the  Revolutionary  War  as  pure  technical,  on-the-job, 

seamanship  training  with  practical  fleet  leadership  exposure.  It  then  shifted  to  a  hybrid  of 

classroom  training  and  fleet  training  in  1845.  By  1851,  the  Naval  Academy  had  completed  the 

11 


evolution  by  going  to  college-like  classroom  instruction,  for  a  standardized  period  of  time,  with 
less  informal  exposure  to  the  fleet. 

b)  Purpose 

The  current  purpose  of  the  United  States  Naval  Academy  is  "To  develop 
midshipmen  morally,  mentally  and  physically  and  to  imbue  them  with  the  highest  ideals  of  duty, 
honor  and  loyalty  in  order  to  provide  graduates  who  have  potential  for  future  development  in 
mind  and  character  to  assume  the  highest  responsibilities  of  command,  citizenship  and 
government"  (United  States  Naval  Academy,  1996b,  p.22).  This  is  a  much  broader  mission 
statement  than  was  first  proposed  to  the  President  or  Congress  in  the  early  1800s  by  proponents 
of  a  Naval  Officer  training  school.  The  mission  of  the  Naval  Academy  has  evolved  as  technology 
and  society  have  advanced.  The  Naval  Academy  has  grown  from  a  school  that  taught  Naval 
Officers  the  basics  in  math,  English,  navigation,  and  steam  propulsion  into  a  fully  accredited 
four-year  degree  granting  college.  The  process  of  fostering  leadership  in  midshipmen  has 
evolved  also.  The  process  has  changed  fi’om  one  in  which  leadership  ability  was  gained  through 
practical  fleet  experience  to  one  where  a  deliberate  attempt  is  made  to  develop  those  abilities 
during  the  midshipman’s  four-year  stay  at  the  Naval  Academy. 

c)  Configuration 

The  evolution  of  the  structure  and  mission  of  the  Naval  Academy  has  had  a 
corresponding  effect  upon  the  Brigade  of  Midshipmen  and  the  development  of  future  Naval 
Officers.  The  Brigade  of  Midshipmen  was  not  always  addressed  as  a  brigade  or  even  a  regiment. 

The  Brigade  has  also  undergone  several  changes  throughout  its  history,  which 
have  included  modifications  in  its  purpose.  The  original  class  began  on  October  10,  1845  with  50 
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midshipmen.  In  1848,  Professor  Lockwood  introduced  military  drill.  This  is  significant  because 
drill  would  later  become  a  means  of  instilling  discipline  and  exercising  midshipman  leadership. 
By  1855  there  were  approximately  140  midshipmen  at  the  Naval  Academy  organized  into  "gun 
crews."  There  were  approximately  10  gun  crews  of  no  more  than  16  men  each.  They  were 
headed  by  a  First  Captain  and  a  Second  Captain  "for  the  pui^se  of  instruction  in  the  use  of 
arms,  and  in  infantry  tactics,  and  for  effecting  inspection  or  other  parades,  mess  arrangements, 
etc"  (Regulations  for  the  Interior  Police  of  the  Naval  Academy,  1858,  p.5).  The  First  Captain  was 
denoted  by  two  stripes  on  his  uniform  (2  striper)  and  the  Second  Captain  had  one  stripe  on  his 
uniform  (1  striper).  This  was  the  beginning  of  the  midshipman  rank  structure. 

In  1869,  enrollment  had  increased  to  approximately  480  midshipmen.  They  were 
organized  into  four  divisions  of  six  gun  crews  each.  The  rank  structure  evolved  finther  as  the 
position  of  cadet  Lieutenant  Commander  was  created.  The  cadet  Lieutenant  Commander  would 
have  four  cadet  Lieutenants  as  junior  officers,  one  for  each  division.  The  cadet  Lieutenants  had 
as  assistants  one  cadet  Ensign  and  one  cadet  NDdshipman  per  division.  The  cadet  Midshipman 
was  an  assistant  to  the  cadet  Ensign.  The  first  and  second  captmns  of  gun  crews  were  still  the 
most  basic  unit  of  the  organization.  The  stated  purpose  was  still  for  artillery  and  infantry  drill 
although  now  the  gun  crews  marched  to  class  (or  recitation).  Two  divisions  formed  a  company 
and  each  ship’s  company  constituted  the  complement  of  a  sloop-of-war.  Although  no  written 
reason  for  having  two  full  complements  of  a  sloop-of-war  could  be  found,  it  might  have  been 
tied  to  the  summer  practice  cruises.  By  1876,  the  formal  duty  of  the  cadet  Lieutenant 
Commander  was  "to  function  as  the  Executive  Officer  would  onboard  a  ship."  (Regulations  of 
the  United  States  Naval  Academy,  1876,  p.3 1). 


13 


In  1909,  the  basis  of  the  Brigade  organization  changed  from  a  sloop-of-war 
complement  to  a  naval  brigade  with  two  battalions  of  six  companies  each.  In  addition  to  drill,  the 
newly  stated  purpose  of  the  midshipmen  brigade  was  to  maintain  discipline  within  the  brigade. 
This  new  responsibility  resulted  in  the  enlargement  of  the  brigade  staff  and  promotion  of  the 
cadet  Lieutenant  Commander  to  Commander.  Adjutants  were  created  to  aid  in  brigade 
administration.  The  battalion  heads  were  then  given  the  rank  of  cadet  Lieutenant  Commander. 

The  Regulations  of  the  United  States  Naval  Academy  formally  changed  the  stated 
purpose  of  the  cadet  company  staff.  "Company  Officers  shall  be  quartered  and  messed  with  their 
companies.  They  are  charged  with  good  order,  discipline,  and  drill  of  their  respective  companies. 
Their  relations  to  those  under  their  command  are  similar  to  those  of  divisional  officers  aboard 
ship.  They  shall  lead,  instruct,  and  advise  their  men."  (Regulations  of  the  United  States  Naval 
Academy,  1907,  p.l9).  This  does  not  refer  to  commissioned  Company  Officers,  who  did  not  yet 
exist,  but  rather  the  appointed  cadet  officers. 

The  1907  regulation  marked  the  first  time  midshipmen  were  leading  other 
midshipmen  for  other  than  a  parade  or  organizational  purpose.  It  is  a  departure  from  the  previous 
years  because  it  formally  suggests  developing  leadership  capabilities  in  midshipmen  through 
brigade  administration.  Because  the  regulation  specified  that  the  relationship  “shall  be  similar  to 
those  of  divisional  officers  onboard  ship,”  it  suggested  that  the  new  structure  would  aid  in 
developing  the  experience  base  necessary  to  become  an  effective  conunissioned  officer.  This 
point  is  further  clarified  in  1916  when  the  regulation  stipulated: 
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Midshipman  officers  are  expected  to  realize  folly  the  increased 
responsibility  placed  on  them  and  by  their  strict  attention  to  duty  show  themselves 
worthy  of  the  trust  accorded,  and  thereby  maintain  the  standard  of  discipline  at  the 
Academy,  as  well  as  prepare  themselves  for  the  greater  responsibilities  soon  to  be 
encountered  in  the  service  at  large.  (Regulations  of  the  United  States  Naval 
Academy,  1916,  p.93). 


For  the  next  22  years  the  brigade  organization  and  leadership  challenges  changed 
little,  with  the  exception  of  manipulating  the  number  of  battalions  and  companies  as  enrollment 
varied.  In  1938,  the  brigade  organization  appeared,  as  it  is  known  today.  It  was  set  up  as  one 
naval  regiment  of  four  battalions  with  twelve  companies,  3  per  battalion.  Today  there  are  two 
regiments  of  three  battalions  each,  with  five  companies  per  battalion.  See  below. 


Brigade  of  Mdshpnen 
(1999) 


<9  Role  of  Company  Officer 

When  the  Naval  Academy  initially  formed,  there  were  no  Company  Officers.  Due 
to  the  low  number  of  midshipmen  and  staff,  the  Superintendent  or  the  Commandant,  then  known 
as  the  Executive  Officer  would  inspect  the  mess  and  recitation  halls,  quarters  and  groimds 
(Regulations  of  the  U.S.  Naval  Academy,  1853).  The  initial  austerity  of  the  Naval  School 
required  a  high  degree  of  staff  efficiency.  It  was  the  duty  of  every  officer,  professor,  and 
instructor  attached  to  the  Naval  School  who  knew  of  any  violation  or  improper  conduct  by  a 
midshipman  to  report  it  to  the  Superintendent  (Regulations  of  the  U.S.  Naval  Academy,  1853). 
The  professors  and  instructors  were  responsible  for  the  "regular  and  orderly  conduct”  of  their 
respective  class. 

By  1858,  the  Commandant  had  three  assistants,  "each  of  whom  occupy  a  rank  not 
below  that  of  Master"  (Regulations  of  the  U.S.  Naval  Academy,  1855,  p.33).  This  was  a  practical 
requirement  because  the  Commandant  of  the  Naval  Academy  taught  practical  seamanship,  naval 
gunnery,  and  naval  tactics.  It  was  from  these  three  assistants  that  the  Company  Officer  position 
would  evolve.  Their  job  was  also  "to  perform  those  . . .  [duties]. . .  of  executing  the  regulations 
and  order  concerning  police  and  discipline"  (Regulations  of  the  U.S.  Naval  Academy,  1855, 
p.33).  These  assistants  stood  a  24  hour  watch  called  "officer  in  charge,"  similar  to  the  Command 
Duty  Officer  (CDO)  watch  stood  today  by  company  officers. 

There  were  only  minor  changes  up  until  1909,  a  year  that  marked  the  first 
appearance  of  the  Department  of  Discipline.  At  that  time  each  division  had  three  companies, 
with  two  divisions  per  battalion.  Each  Officer-in-Charge  led  a  division  (there  were  four)  and  was 
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responsible  for  the  general  discipline,  neatness,  and  good  order  of  their  companies.  This  was  the 
beginning  of  the  position  we  know  today  as  the  Battalion  Officer. 

By  191 1,  junior  Officers  were  being  assigned  as  assistants  to  the  Officers-in- 
Charge.  "The  junior  officers  will  act  as  assistants  to  the  officers  in  charge  of  divisions  and  will 
be  particularly  charged  with  acquainting  themselves  with  the  members  of  the  companies  under 
their  command,  with  a  view  to  acting  as  advisers  to  the  midshipmen"  (Regulations  of  the  United 
States  Naval  Academy,  191 1,  p.73).  In  1916  the  Officers  in  Charge  of  divisions  were  renamed 
Battalion  Officers  with  the  junior  Officers  as  assistant  Battalion  Officers. 


Brigade  of  Midshipmen 
(1909) 


The  Brigade  assumed  the  battalion  system  we  see  today  with  Company  Officers 
and  Battalion  Officers  by  1933.  A  key  event  in  1938  was  the  change  in  the  duties  of  the 
commissioned  Officers  appointed  over  the  midshipmen: 
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...In  the  perfonnance  of  their  duties  these  officers  are  charged  with  the 
development  in  midshipmen  of  the  qualities  of  character  and  sound  leadership 
necessary  in  the  naval  officer.  They  shall  delegate  to  the  midshipman  officers  and 
petty  officers  the  administration  and  responsibility  for  the  mainten^ce  of  good 
order  and  discipline  within  the  battalion  so  far  as  the  experience,  ability  and  time 
of  the  midshipman  concerned  will  permit.  They  shall  act  on  the  principle  of 
supervision  of  midshipmen  administration  rather  than  on  the  principle  of 
administration  with  midshipmen  acting  as  their  assistants.  (Regulations  of  the 
United  States  Naval  Academy,  1938,  p.29) 

It  was  now  the  responsibility  of  the  commissioned  Battalion  Officer  and 
Company  Officer  to  ensure  that  the  brigade  operated  with  midshipman  administration  and  officer 
supervision  rather  than  officer  administration  with  midshipman  assistance.  This  clearly  shows 
the  intention  that  the  midshipmen  should  be  gaining  leadership  experience  fi'om  occupying  these 
positions.  It  also  illustrates  the  changing  role  of  the  Company  Officer  from  disciplinarian  to 
adviser  to  leadership  developer. 

B.  LEADERSHIP 

Leadership  and  management  are  not  the  same  thing  (Cronin,  1983;  Kotter,  1990). 
“Management  is  about  coping  with  complexity. .  .Leadership,  by  contrast  is  about  coping  with 
change”  (Kotter,  1990,  p.  104).  Officers  in  the  Navy  must  deal  with  both  complexity  and  change. 
Kotter  goes  on  to  say  that  the  real  challenge  is  combining  strong  leadership  and  strong 
management,  using  each  to  balance  the  other  (1990).  If  the  Navy  is  to  “do  more  with  less”  and  be 

battle  ready,  naval  officers  must  possess  these  skills. 

Joint  Vision  2010  echoes  this  sentiment.  “The  dynamic  nature  of  joint  operations  in  the 
21®^  century  battlespace  vrill  require  a  continued  emphasis  on  developing  strong  leadership 
skills ...  In  short,  our  leaders  must  demonstrate  the  very  highest  levels  of  skill  and  versatility  in 
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ever  more  complex  joint  and  multinational  operations”  (U.S.  Department  of  Defense,  Office  of 
the  Chairman  of  the  Joint  Chiefs  of  Staff,  1996,  pp.28-29). 

The  Naval  Academy  must  produce  naval  leaders  of  the  future  who  possess  the  leadership 
and  the  management  skills  required  in  dealing  with  change  and  complexity.  These  skills  must  be 
learned,  which  is  why  we  have  for  some  time  tried  to  teach  them.  However,  new  research  shows 
that  our  traditional  methods  are  not  as  effective  as  they  could  be.  Peter  Senge,  in  “The  leader’s 
new  work:  building  learning  organizations”  states  that  people  inherently  want  to  learn.  He  further 
states  that  the  current  institutions  of  society  are  set  up  to  control,  rather  than  foster  learning. 

Unfortimately,  the  primary  institutions  in  our  society  are  oriented 
predominantly  toward  controlling,  rather  than  learning,  rewarding  individuals  for 
performing  for  others  rather  than  for  cultivating  their  natural  curiosity  and 
impulse  to  learn  ...Ironically,  by  focusing  on  performing  for  someone  else’s 
approval,  corporations  create  the  very  conditions  that  predestine  them  to  mediocre 
performance.  Over  the  long  run,  superior  performance  depends  on  superior 
learning  (1990,  p.7). 

The  Naval  Academy  as  a  learning  institution  controls  more  aspects  of  a  student's 
(midshipman)  life  than  any  other  institution  of  higher  learning.  Midshipmen  are  forced  to  go  to 
class.  They  are  t<dd  when  they  can  go  out,  for  how  long,  and  how  to  act.  How  can  the  Naval 
Academy  take  advantage  of  Peter  Senge’s  ideas  while  providing  the  leaders  required  by  Joint 
Vision  2010?  How  can  the  institution  free  people  to  learn  without  controlling  them  or  teaching 
them  to  perform  for  others?  Performance  management  provides  one  answer. 

‘The  evolution  of  the  concept  of  performance  management  as  a  new  human  resource 
management  model  reflects  a  change  of  emphasis  in  organizations  away  from  command-and- 
control  toward  a  facilitation  model  of  leadership”  (UCSD  Human  Resources  Department,  1997). 

The  facilitator  in  this  case  is  the  Company  Officer. 
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Most  practical  midshipmen  leadership  and  management  experience  is  gained  through 
operation  of  the  regimental  brigade.  The  Company  Officer  supervises  the  operation  of  the 
company  while  at  the  same  time  mentoring  the  midshipmen.  Thus  the  Company  Officer  has  a 
large  effect  on  the  immediate  learning  environment.  The  style  and  practices  of  the  Company 
Officer  will  influence  the  acquired  abilities  of  the  midshipmen. 

Company  officers  are  involved  in  performance  management  whether  they  realize  it  or 
not.  Company  officers  are  also  involved  in  performance  management  regardless  of  whether  or 
not  their  practices  work  to  encourage  continuous  improvement.  According  to  the  Human 
Resource  Management  Department  of  the  University  of  California  at  San  Diego,  you  are 
involved  in  performance  management  when  you: 

•  write  job  descriptions. . .  and  apply  performance  standards 

•  discuss  job  performance  with  the  employee  [midshipmen] 

•  provide  feedback  on  strengths  and  improvements 

•  conduct  an  annual  performance  evaluation.  (UCSD,  1997,  p.l) 

Company  Officers  do  all  of  these,  which  makes  them  "pivotal  to  the  development  of  the 
leadership  and  professional  capabilities  of  the  midshipman"  (Board  of  Visitors,  1997,  p.22). 
Company  Offices  using  performance  management  techmques  can  move  away  fi'om  the 
command-and-control  model  toward  a  facilitation  model  of  leadership.  Using  effective 
performance  measures  in  the  proper  framework  can  make  Senges  s  learning  environment 
possible  and  provide  the  Navy  with  superior  officers. 
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C.  PERFORMANCE  MANAGEMENT 


Performance  management  has  generated  increasing  interest  since  the  end  of  the  last 
decade.  State  and  local  municipalities,  public  and  private  institutions,  and  the  federal  government 
have  all  seen  the  need  to  implement  performance  management  principles  and  performance 
measurement  techniques  (Kravchuk  &  Schack,  1996;  Davis,  1995;  National  Performance 
Review,  1997;  National  Academy  of  Public  Administration,  1994).  Performance  management 
involves  using  performance  measurement  information  to: 

•  help  set  agreed  upon  performance  goals 

•  allocate  and  prioritize  resources 

•  inform  managers  to  either  confirm  or  change  current  policy  or  program  directions  to 
meet  those  goals 

•  report  on  the  success  in  meeting  those  goals 

(National  Performance  Review,  1997,  p.31). 

Nothing  illustrates  this  more  than  the  Government  Performance  and  Results  Act  of  1993, 
hereafter  referred  to  as  GPRA. 

GPRA  requires  every  federal  department  and  agency  to  participate  in  paformance 
tn^^nagftmftnt  Each  federal  department  and  agency  has  had  to  develop  five-year  strategic  plans 
since  1997.  These  strategic  plans  are  linked  to  measurable  outcomes  by  required  annual 
performance  plans.  These  performance  plans  consist  of  specific  performance  indicators  and 
"objective,  quantifiable,  and  measurable"  goals  for  each  activity  in  the  department's  budget. 
"Such  plan  shall— 

1 .  establish  performance  goals  to  define  the  level  of  performance  to  be  achieved  by  a 

program  activity; 
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2.  express  such  goals  in  an  objective,  quantifiable,  and  measurable  form  unless  authorized 
to  be  in  an  alternative  form  under  subsection  (b); 

3.  briefly  describe  the  operational  processes,  skills  and  technology,  and  the  human,  capital, 
information,  or  other  resources  required  to  meet  the  performance  goals; 

4.  establish  performance  indicators  to  be  used  in  measuring  or  assessing  the  relevant 
outputs,  service  levels,  and  outcomes  of  each  program  activity; 

5.  provide  a  basis  for  comparing  actual  program  results  with  the  established  performance 
goals;  and 

6.  Describe  the  means  to  be  used  to  verify  and  validate  measured  values. "  (United  States 
Congress,  1993,  sec.  1115) 


1.  Performance  Measurement  in  Education 

Educational  institutions  have  also  implemented  performance  management  techmques. 
Performance  management  in  this  setting  is  usually  a  human  relations  tool  in  the  association 
between  the  institution's  administration  and  its  teachers  (Davis,  1995;  Down,  Hogan,  & 
Chadboume,  1999).  Hogan  and  Chadboume  discuss  some  of  the  problems  associated  with 
performance  measurement  in  this  setting  (1999).  In  this  situation,  the  measures  indicate  the 
performance  of  the  teachers.  To  date,  the  use  of  performance  management  techniques  to  indicate 
improvements  in  student  performance  has  not  been  documented. 

The  University  of  Arizona  is  one  of  the  few  educational  institutions  found  to  be 
implementing  performance  measures,  although  not  the  kind  examined  in  this  study.  In  a  1997 
report,  they  generated  seven  goals  for  the  institution  with  thirty-six  measures  to  indicate  progress 
towards  those  goals  (University  of  Arizona,  1997).  Some  of  the  measures  are  listed  below. 

•  Percentage  of  freshman  returning  their  second  year 

•  Percentage  of  full  time  freshman  graduating  in  six  years. 

•  Percentage  of  full-time  lower-division  transfer  students  graduating  in  five  years. 
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•  Average  time  taken  by  students  entering  as  freshmen  to  complete  a  Baccalaureate 
degree. 

•  Percent  of  students  satisfied  with  advising. 

•  Level  of  satisfaction  of  Arizona  employers  with  recent  graduates. 

•  Percent  of  recent  graduates  reporting  adequate  or  better  than  adequate  preparation  for 
long  term  career  goals  (University  of  Arizona,  1997,  pp.4  -13). 

The  University  of  Arizona  was  looking  to  improve  as  an  institution,  the  service  it 
provides  in  seven  areas,  not  to  necessarily  improve  the  performance  of  the  students.  It  is  true  that 
attributes  of  the  Arizona  students  were  used  as  indicators,  but  it  was  not  with  an  intention  of 
feeding  their  performance  back  to  them  for  improvement.  It  was  rather,  as  mentioned  to  improve 
the  institution’s  providing  of  services  to  its  customer  base.  This  research  of  the  Naval  Academy 
Company  Officers  sought  to  examine  measures  used  to  indicate  and  improve  midshipmen 
performance. 

2.  Performance  Measurement  in  the  Department  of  Defense 

The  Navy  complies  with  the  terms  of  GPRA  through  the  Department  of  Defense.  The 
Quadrennial  Defense  Review  (QDR)  serves  as  the  department's  overall  strategic  planning 
document,  and  fulfills  the  strategic  planning  requirements  of  GPRA  (Office  of  the  Secretary  of 
Defense,  1997). 

Within  the  military  most  of  the  performance  measurement  applications  continue  to  deal 
with  easily  quantifiable  goals,  targets,  and  numbers.  As  a  result  performance  management  is 
most  easily  implemented  within  the  DOD  areas  of  budgeting,  acquisition,  and  construction  or 
repair  (Air  Force  Systems  Command,  1991;  Gordon,  1997;  Fuhs,  1998). 
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In  1996,  Robert  Smith  conducted  a  study  outside  this  norm.  Smith  explored  how  the 
Commander  in  Charge  of  the  Atlantic  Fleet  (CINCLANTFLT)  and  its  action  agent  the  George 
Washington  Battle  Group  (GWBG)  developed  a  performance  plan,  performance  metrics  for  the 
battle  group,  and  a  performance  measurement  system  that  supported  the  process  of  performance 
management.  This  was  done  as  a  Navy  pilot  project  in  support  of  GPRA. 

The  measurement  and  feedback  mechamsms  that  performance  management  provides  can 
help  develop  and  improve  future  naval  officers.  “Performance  management  is  a  joint  process  that 
involves  both  the  supervisor  and  the  employee,  who  identify  common  goals,  which  correlate  to 
the  higher  goals  of  the  institution.  This  process  results  in  the  establishment  of  written 
performance  expectations  later  used  as  measures  for  feedback  and  performance  evaluation 
(Davis,  1995,  p.l5). 

This  statement,  although  written  by  the  leader  of  a  public  university  about  the 
relationship  between  supervisors  and  teachers,  can  also  be  applied  to  the  relationship  between  the 
Company  Officer  and  midshipman.  The  supervisor  in  this  case  is  the  Company  Officer  and  the 
employee  is  the  midshipman.  It  is  the  Company  Officer's  job  to  develop  the  leadership  and 
management  capabilities  of  his  or  her  midshipmen  to  their  fullest  extent.  Performance 
measurement  can  be  a  useful  tool  in  this  endeavor. 

The  closest  thing  to  a  performance  measurement  system  at  the  Naval  Academy  is  the 

annual  Color  Company  Competition.  It  ranks  all  thirty  companies  based  on  how  the  company 

performed  in  such  things  as  academics  (GPA),  drill,  tactical  exercises,  ship  handling  skills, 

intramural  results,  and  more  (United  States  Naval  Academy,  1996a).  The  Air  Force  has  a  similar 

competition  called  the  Outstanding  Squadron  Award.  It  is  also  based  on  academics,  physical 

fitness,  and  intramurals  (United  States  Air  Force  Academy,  1997).  West  Point  has  a  similar 
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award  but  it  is  not  rank  order  based.  Whereas  the  Naval  Academy  and  Air  Force  Academy  award 
their  honor  on  only  the  top  company.  West  Point  sets  a  benchmark  and  any  company  that 
achieves  that  score  receives  the  award  (United  States  Military  Academy,  1998). 

3.  Performance  Measurement  Approaches 

Performance  measurement  should  accomplish  three  things.  First  it  should  provide  focus, 
direction,  and  a  common  understanding.  Secondly,  performance  measurement  should  provide 
knowledge  for  making  future  decisions,  and  thirdly  provide  feedback  on  improvement  efforts 
(Chang  &  DeYoung,  1997).  The  Training  Resources  and  Data  Exchange  (TRADE)  Group,  a 
special  project  group  for  the  Assistant  Secretary  of  Defense  and  the  Department  of  Energy,  also 
adds  that  control  is  a  goal.  "If  you  cannot  measure  an  activity,  you  caimot  control  it"  (1995,  p.l- 
7).  This  refers  to  controlling  the  outcomes,  not  necessarily  the  people  performing  the  process. 

To  accomplish  these  goals  an  organization  needs  a  clear  and  concise  conceptual 
framework,  a  disciplined  approach  to  the  performance  management  and  measurement  system. 

All  members  of  the  organization  should  understand  this  framework.  It  should  support  the 
objectives  of  the  organization  and  the  collection  of  data  (Chang  &  DeYoung,  1997;  National 
Performance  Review,  1997;  TRADE,  1995). 

Within  the  performance  management  field  of  research  there  are  a  number  of  approaches 
to  performance  measurement.  Chang  &  DeYoung's  Measurement  Linkage  Model,  National 
Performance  Review's  study  findings,  the  TRADE  Group's  three  different  approaches,  and  the 
U.S.  Air  Force's  Metric  Development  Process  are  all  examples  of  performance  measurement 
systems.  Each  system  leads  to  the  design  of  a  custom  made  organizational  performance 
measurement  tool.  Each  uses  terms  specific  to  that  approach  but  with  the  same  context.  What  is 
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called  a  performance  measure  in  one  system  or  framework,  is  a  key  indicator  or  metric  in 
another.  For  the  purposes  of  this  research,  a  performance  measure  is  a  qualitative  or  quantitative 
measure  of  performance. 

All  of  the  performance  measurement  systems  examined  have  a  number  of  things  in 
conunon.  All  have  between  six  and  ten  steps  designed  to  produce  the  same  result.  The  basic 
performance  measurement  process  begins  with  examining  the  organization's  mission  and  the 
mission  of  each  work  group  within  the  organization.  The  process  then  examines  areas  within  the 
organizational  mission  that  need  improvement.  The  succeeding  steps  outline  each  specific  work 
group's  effect  on  those  areas.  The  performance  measure,  which  operationalizes  the  measurement 
of  that  area,  is  then  constructed. 

One  of  the  most  difficult  aspects  of  this  entire  process  is  the  selection  and  collection  of 
good  performance  measures.  The  measured  indicator  must  give  good,  "actionable"  data  (Chang 
&  DeYoung,  1995).  With  good  data  one  can  establish  a  benchmark.  The  benchmark  is  a  standard 
for  measuring  improvement  as  well  as  setting  performance  targets.  A  time  period  is  then  set 
during  which  the  performance  is  measured.  Feedback  is  generated  by  the  performance  manager 
from  the  knowledge  of  whether  the  performance  targets  were  met  in  relation  to  the  benchmark. 
Continuous  improvement  is  derived  from  the  use  of  feedback  and  re-examination  of  the 
performance  measures  (Chang  &  DeYoung,  1997;  National  Performance  Review,  1997; 

TRADE,  1995). 

4.  The  Measurement  Linkage  Model 

This  research  and  analysis  will  use  Chang  &  DeYoung's  Measurement  Linkage  Model 
(MLM)  (1997).  Its  simplicity  and  flexibility  make  it  suitable  for  non-business  organizations  such 
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as  the  Naval  Academy.  The  MLM  is  shown  on  the  next  page.  There  are  eight  basic  steps  to 
accomplish  in  the  MLM.  To  maintain  continuous  improvement  the  measurement  process 
requires  a  ninth  step.  This  involves  a  review  and  possible  realignment  of  key  result  areas  (KRAs) 
and  key  indicators  (BQs)  as  shown  in  the  diagram. 

The  first  step  in  the  MLM  is  to  develop  organization-wide  KRAs,  KIs,  and  performance 
targets.  A  key  result  area,  or  KRA  is  a  "critical,  'must  achieve,'  'make-or-break'  performance 
category  for  an  organization"  (Chang  &  DeYoung,  1995,  p.  17).  A  key  indicator  or  KI  is  the 
actual  performance  measure.  "A  KI  is  the  metric  ...  by  which  an  organization  can  evaluate 
achievement  toward  its  KRAs"  (Chang  &  DeYoung,  1995,  p.l8).  The  organization's  strategic 
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Measurement  Linkage  Model 
(1995) 
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Plan,  mission  statement,  and  vision  statement  will  be  referenced  in  the  process  of 
generating  organization-wide  KRAs  and  KIs. 

T5rpically  an  organization  will  have  between  four  and  ten  KRAs.  Performance  targets  are 
the  specific  goals  set  for  a  particular  KI  (Chang  &  DeYoung,  1995).  For  example,  at  the  Naval 
Academy  some  organizational-wide  KRAs  might  be  moral,  mental  and  physical  development. 
Academic  grade  point  average  (GPA)  might  be  a  KI  under  the  KRA  of  mental  development.  A 
performance  target  for  the  KI  of  grade  point  average  might  be  2.5. 

In  step  two,  organization-wide  KRAs  and  KIs  are  selected  that  are  linked  to  your  work 
group.  Not  all  organization-wide  KRAs  and  KIs  will  apply  to  all  work  groups.  To  do  this 
requires  that  the  group: 

•  Understand  the  organization’s  vision  and  mission. 

•  Identify  how  the  particular  group  functions  as  a  system. 

•  T.ink  to  organizational  KRAs  and  KIs  (Chang  &  DeYoung,  1995,  p.39). 

St^  three  then  makes  the  KRAs  specific  to  the  work  group.  The  work  groups  KRAs  are 
areas  that  the  work  group  is  held  accountable  for  achieving  (Chang  &  DeYoung,  1995).  A  work 
group  KRA  might  be  academic  paformance,  as  opposed  to  the  organization-wide  mental 
development.  It  is  still  within  the  same  organizational  KRA  but  is  more  specific  to  the  work 
group.  Step  four  continues  with  determining  work  group  specific  KIs.  "KIs  are  measures  that 
determine  how  well  a  work  group  is  accomplishing  a  KRA"  (Chang  &  DeYoung,  1995,  p.63). 

Determining  data  collection,  tracking,  and  feedback  methods  is  the  next  step.  This 
involves  asking  and  answering  the  following  questions: 

•  Who  will  collect  it 

•  How  will  it  be  collected 
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•  Where  will  the  data  be  accessibly  stored  so  performance  may  be  monitored 

•  Over  what  time  period  will  it  be  collected  and  available  (Chang  &  DeYoimg,  1995, 

P-73) 

Once  the  work  group  understands  what  it  is  responsible  for,  and  how  it  will  monitor  its  specific 
indicators,  then  goals  must  be  set.  These  goals  are  called  performance  targets.  To  set  a 
performance  target  one  must  know  what  is  possible.  "Many  managers  have  unrealistic 
expectations  of  how  much  their  work  groups  can  improve,  because  they  do  not  understand  what 
their  current  processes. . .  are  capable  of  producing.  With  the  best  of  intentions,  they  set  targets 
that  are  not  achievable  while  the  processes  are  the  same"  (Chang  &  DeYoung,  1995,  p.79). 
Monitoring  a  particular  KI  for  a  set  time  period  will  help  establish  a  'baseline'  from  which  to  set 
a  performance  target. 

The  remaining  steps  of  the  MLM  first  focus  on  establishing  work  group  "objectives"  and 
"tactics,"  to  achieve  the  newly  set  performance  targets.  Those  “objectives”  and  “tactics”  are  then 
consolidated  into  plans.  Those  plans  are  then  implemented  while  monitoring  performance  and 
providing  feedback. 

The  next  chapter  examines  the  performance  measures  that  Company  Officers  currently 
use  to  assess  midshipman  and  company  performance.  Chapter  ft)ur  will  then  analyze  those 
measures  against  the  MLM  to  evaluate  whether  they  are  good,  "actionable"  KIs  used  in 
accordance  with  the  MLM  of  Chang  &  DeYoung. 
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BEL  OVERVIEW  OF  CURRENT  PRACTICES 

TMs  chapter  will  examine  the  measures  of  performance  currently  being  used  by 
Company  Officers  at  the  United  States  Naval  Academy.  They  are  measures  of  performance 
because  they  are  used  by  Company  Officers  to  gauge  the  performance  of  the  company.  They  will 
be  referred  to  as  measures  of  performance  until  analysis  shows  in  the  next  chapter  whether  they 
are  performance  measures  in  a  performance  management  sense. 

This  thesis  is  the  result  of  a  class  project  in  performance  measurement.  Eleven  students 
were  broken  into  four  groups.  The  eleven  students  then  surveyed  eleven  Naval  Officers  who 
were  Company  Officers  during  the  1997-98  academic  year.  The  Company  Officers  were  asked 
what  they  monitored  to  gauge  company  performance.  The  students  then  pooled  their  data  within 
the  respective  groups  and  made  a  group  presentation  of  their  findings. 

The  data  fi-om  the  four  groups  formed  the  basis  of  a  pre-interview  questionnaire.  This 
questionnaire  was  distributed  to  15  Company  Officers  prior  to  their  interview  to  (a)  introduce  the 
interview  (b)  help  focus  their  thoughts  (c)  get  them  thinking  about  the  topic  before  the  interview 
and  (d)  make  the  interview  more  effective.  The  pre-interview  sheet  is  included  at  the  end  of  this 
chapter. 

Fifteen  Company  Officers  were  interviewed,  including  4  Marines,  3  Smface  Warfare 
Officers,  5  Submarine  Officers,  2  Aviators,  and  1  SEAL  (Sea-Air  Land  Special  Forces).  The 
Company  Officers  were  spread  out  among  all  six  Battalions. 

A.  THE  MEASURES 

There  were  16  measures  of  performance  listed  in  the  pre-interview  sheet,  which  require 
explanation  in  order  to  understand  the  property  to  be  measured.  Many  of  the  measures  are  factors 
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in  the  annual  Color  Company  Competition  (CCC).  Color  Company  is  that  company  which 
accumulates  the  most  “color  points”  over  a  year.  Some  of  the  accomplishments  listed  below  earn 
company  color  points.  There  are  rewards  for  winning  CCC.  The  Color  Company  picks  a  ‘Color 
Girl  or  Boy’  to  march  in  the  Color  Parade  during  graduation  week  in  the  spring.  The  Color 
Company  gets  selective  parking  on  the  yard,  which  is  much  coveted  (United  States  Naval 
Academy,  1996a).  The  Color  Company  can  award  more  As  and  Bs  in  performance  than  any 
other  company.  Currently  only  up  to  30%  of  the  midshipmen  in  a  particular  company  may 
receive  As  in  military  performance,  and  40%  Bs.  (United  States  Naval  Academy,  1998b) 

Some  Company  Officers  use  the  Physical  Readiness  Test  (PRT)  results  as  a  measure  of 
performance.  The  PRT  is  an  endurance  test  given  twice  a  year.  It  is  given  in  the  very  beginning 
of  the  semester.  The  PRT  is  a  graded  physical  test  with  grades  ranging  from  A  to  F.  It  is  the  same 
test  given  to  all  sailors  in  the  fleet  with  one  exception;  the  minimum  standards  are  higher.  The 
PRT  consists  of 

•  Maximum  number  of  push-ups  in  two  minutes,  followed  by 

•  Maximum  number  of  sit-ups  in  two  minutes,  followed  by 

•  A  one  and  a  half-mile  run  based  on  time. 

There  are  many  midshipmen  who  return  from  cruise  on  board  a  ship  or  summer  leave  and 
initially  fail  the  PRT.  They  must  then  remediate.  This  entails  taking  it  again  and  again  until  the 
midshipman  passes  with  at  least  a  D. 

Physical  education  (PE)  grades  are  also  monitored  by  some  Company  Officers.  PE 

grades  are  merely  the  grade  the  midshipman  receives  in  physical  education  class.  PE  grades 

range  from  A  to  I  (A,  B,  C,  D,  F,  I)  in  whole  letter  increments.  The  midshipman's  PRT  score  is 

also  factored  into  the  PE  grade  for  that  semester.  PE  grades  are  reported  at  the  end  of  the 
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semester.  They  are  the  only  academic  grades  not  reported  at  each  of  the  three  6-week  marking 
periods. 

The  semester  is  divided  into  three  marking  periods  with  grades  reported  every  six  weeks 
during  the  semester.  In  this  study,  overall  grade  point  average  (GPA)  as  a  measure  of 
performance  refers  to  both  a  midshipman's  current  semester  grades  (SQPR)  and  cumulative  GPA 
(CGPA).  Company  Officers  used  both.  Companies  are  academically  ranked  by  SQPR  at  every 
marking  period.  Color  points  are  awarded  based  on  the  company's  academic  rank  in  the  brigade. 
Cumulative  GPA  is  monitored  for  long  term  trends  and  eventual  graduation.  A  2.0  CGPA  is 
necessary  to  graduate.  Many  of  the  Company  Officers  interviewed  monitored  GPA. 

GPA  delta  refers  to  the  difference  between  a  midshipman's  current  GPA  and  his  or  her 
cumulative  GPA.  The  midshipmen  can  earn  extra  liberty  weekends  by  obtaining  a  GPA  delta 
equal  to,  or  greater  than  0.3  (United  States  Naval  Academy,  1998c). 

Class  absences  are  entered  into  a  computer  database  by  the  professors  after  each  class. 
This  database  can  be  accessed  by  the  Company  Officer  to  see  who  has  been  absent  fi'om  class. 
Class  absences  are  not  permitted  by  Midshipmen  Regulations  (United  States  Naval  Academy, 
1998c).  Midshipmen  may  be  punished  for  unauthorized  absences  from  class. 

Midshipmen  do  not  lie,  cheat,  or  steal.  They  live  by  an  honor  concept  (United  States 
Naval  Academy,  1994).  This  honor  concept  is  run  and  enforced  by  the  Brigade  of  Midshipmen. 
Each  company  has  four  honor  representatives,  one  from  each  class.  These  representatives  give 
periodic  honor  training,  and  answer  questions  from  midshipmen  about  honor  issues.  Some 
Company  Officers  monitor  the  number  of  questions  the  honor  representatives  receive,  either 
weekly  or  during  the  semester. 
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The  Academic  Board  meets  periodically  during  the  semester  and  at  the  end  of  each 
semester  to  review  the  records  of  deficient  midshipmen.  The  Board  then  decides  whether  to 
separate  or  retain  that  particular  midshipman  (United  States  Naval  Academy,  1998a). 
Midshipmen  can  be  referred  to  the  Academic  Board  for  a  number  of  reasons,  such  as:  a 
deficiency  in  PE,  excessive  failures  on  the  PRT,  GP  A  too  low,  and  alcohol  or  other  medical 
(United  States  Naval  Academy,  1998a;  United  States  Naval  Academy,  1998d).  Some  Company 
Officers  monitor  the  number  of  semester  Academic  Board  (AC  Board)  cases. 

The  Naval  Academy  administers  a  weight  control  program  to  those  midshipmen  who  fail 
outside  the  Navy’s  allowable  limits  for  body  fat  and/or  weight.  This  program  consists  of  weekly 
weigh-ins  and  exercise.  Category  5  (CAT  5)  midshipmen  are  those  who  are  outside  the  Navy 
limit  for  body  fat.  Category  6  (CAT  6)  midshipmen  are  those  who  were  CAT  5  and  have  lowered 
their  body  fat  to  within  the  limit  (United  States  Naval  Academy,  1998d).  Some  Company 
Officers  monitor  the  number  of  CAT  5  and  6  midshipmen  in  their  companies. 

r 

Sick-in-room  (SIR)  chits  are  recommendations  from  the  Medical  Department  that  a 
particular  midshipman  be  excused  from  a  variety  of  activities,  including;  class,  drill,  formations, 
or  some  other  activity,  due  to  illness.  A  SIR  midshipman  should  be  in  his  or  her  room 
recuperating.  Some  Company  Officers  track  the  number  of  SIR  chits  to  particular  midshipmen. 

Attendance  at  company  functions  is  another  attribute  monitored  by  some  Company 
Officers.  It  is  seen  as  an  indicator  of  morale,  or  command  climate.  Company  fonctions  are  things 
such  as  tailgaters,  dining-in,  dining-out,  company  athletic  events,  and  barbecues  or  picnics. 
Morale  was  also  an  attribute  directly  measured  by  a  few  Company  Officers.  Company  First 
Sergeants  derive  the  measure  on  their  own.  It  is  a  subjective  measure  of  morale  based  on 
feedback  to  the  first  sergeant  during  the  week,  usually  on  a  4.0  scale. 
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It  is  mandatory  that  midshipmen  participate  in  at  least  one  athletic  team  per  season. 
Participation  can  be  either  on  a  varsity  sport  team,  approved  club  sport,  or  intramural.  Every 
company  fields  an  intramural  team  in  each  of  several  sports,  per  semester.  Companies  earn 
points  toward  Color  Company  competition  for  wins  or  ties.  They  lose  points  if  their  company 
referees  do  not  show  up  to  referee  their  assigned  games.  Some  Company  Officers  monitor  the 
company’s  success  in  intramural  sports. 

Drill  is  another  event  that  can  earn  a  company  color  points.  There  are  practice  parades 
and  real  parades  to  honor  dignitaries.  They  are  all  graded.  Midshipman  Drill  Officers  or  Marines 
rank  the  performance  of  all  thirty  companies  after  each  parade.  The  average  of  the  company’s 
drill  grades  is  used  to  rank  all  30  companies  for  that  semester.  Color  points  are  awarded  based  on 
semester  ranking.  Company  Officers  track  weekly  and  semester  drill  grades  as  an  indicator  of 
performance. 

B.  THE  DATA 

Interviewing  the  Company  Officers  was  a  two  step  process.  The  pre-interview  sheet  on 
the  last  page  of  this  chapter  was  dropped  off  one  to  two  days  prior  to  the  interview.  This  allowed 
the  Company  Officers  to  complete  it  at  their  own  pace,  with  the  benefits  previously  mentioned. 
At  the  interview  the  pre-interview  sheet  served  to  answer  the  immediate  question  of  which 
measures  of  performance  were  used.  Questions  would  then  probe  the  way  the  measures  were 
monitored,  tracked,  and  fed  back  to  the  midshipmen.  This  information  is  used  in  the  next  chapter 
to  analyze  if  the  measures  of  performance  are  true  performance  measures  in  a  performance 
measurement  system. 
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The  data  is  displayed  on  the  next  page  in  bar  graph  format.  It  is  the  graphical  result  of  the 
interviews.  All  measures  are  displayed  out  of  the  possible  maximum  of  fifteen.  The  measures 
were  used  with  the  following  fi’equencies  by  Company  Officers:  (15)  PRT  results,  (6)  PE  grades, 
(15)  Overall  GPA,  (9)  GPA  delta,  (12)  Absences,  (0)  Number  of  honor  offenses,  (0)  number  of 
questions  to  honor  representatives,  (3)  El  hours,  (8)  number  of  Ds  and  Fs  in  military 
performance,  (9)  Number  of  Midshipmen  going  to  academic  boards,  (9)  Number  of  Midshipmen 
in  weight  control  category  5  and  6,  (7)  Numbers  of  SIR  chits,  (3)  Attendance  at  company 
functions,  (7)  Success  in  intramural  sports,  (12)  Drill  performance,  and  (7)  morale. 


The  data  from  the  interviews  was  tabulated  and  displayed  using  SPSS  7.5. 
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These  measures  are  much  more  specifically  focused  on  individual  midshipman  and 
company  performance  as  opposed  to  those  of  the  institution,  as  with  the  University  of  Arizona. 
The  most  frequently  used  measures  were  absences,  GPA,  PRT  Results,  and  drill  performance. 
However,  most  used  does  not  necessarily  mean  properly  used.  The  next  chapter  will  examine 
each  measure  against  criteria  from  the  Measurement  Linkage  Model  of  Chang  and  DeYoung. 
The  MLM  criteria  will  determine  if  the  measure  is  used  as  a  true  performance  measure. 
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Company  Officer  Interview 


The  purpose  of  this  interview  is  to  develop  an  understanding  of  the  way  in  which 
company  officers  gauge  the  performance  of  the  company.  This  interview  is  being  done  as  part  of 
an  analysis  of  performance  measures  used  by  company  officers  for  my  Master's  thesis.  This  is 
the  first  in  a  series  of  thesis  work  that  will  examine  which  aspects  of  company  performance 
provide  use&l,  measurable  benchmarks.  The  end  result  will  be  performance  measurement 
software  tool  to  track  company  performance. 

This  interview  will  attempt  to  discover  what  things  are  important  and  deserve  attention 
and  which  do  not.  It  is  not  an  opinion  poll.  I  want  to  know  what  things  you  actively  look  at  day- 
to-day,  month-to-month,  or  semester-to-semester  to  determine  how  the  company  is  performing 
and  use  to  provide  feedback  to  the  midshipmen.  The  questions  are  designed  to  provoke  thought, 
not  to  narrow  the  scope.  If  there  are  things  you  monitor  that  are  not  mentioned  please  feel  fi'ee  to 
add  them.  Key  things  to  keep  in  mind  as  you  go  through  this  pre-interview  sheet  are;  What  do  1 
look  at?  How  do  I  use  the  information  I  look  at?  How  does  it  get  fed  back/not  get  fed  back  to  the 
midshipmen  so  as  to  affect future  performance? 


Some  of  the  things  listed  below  were  noted  in  company  officer  interviews  as  being  important  or 
deserving  attention.  Which  of  them  do  you  monitor?  (circle) 


PRT  Results  PE  grades  Overall  grade  point  average 

GPA  delta  absences 

Number  of  honor  offenses  Number  of  questions  to  honor  reps 

El  hours  Number  of  Ds/Fs  in  performance 

Number  of  mids  going  to  Academic  boards 

Number  of  mids  in  weight  control  category  5  &  6  Success  in  intramural  sports 

Numbers/trends  in  sick-in-room  (SIR)  chits  Drill  performance 

Attendance  at  company  fimctions  Morale 


For  the  things  you  circled  above.  How  are  they  used?  Or  do  you  just  monitor  it  for  information? 
(In  other  words,  how  does  the  information  get  fed  back  to  the  mids?  -  form  2,  counseling, 
performance  grade,  goal  setting  session,  etc) 
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Were  there  any  that  you  monitor  that  were  not  mentioned? 


Are  there  any  tools  you  have  found  useful?  (By  tools  I  mean  either  automated,  i.e.:  computer,  or 
mechanical  i.e.:  bulletin  boards,  etc) 


Are  there  any  tools,  methods,  or  systems  that  you  feel  pressured  to  use  that  you  feel  do  not 
accomplish  a  useful  purpose? 


How  do  you  see  your  role  contributing  to  leadership  development  in  the  midshipmen? 
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IV.  DATA  ANALYSIS 


This  chapter  analyzes  the  data  presented  in  the  previous  chapter.  Each  measure  of 
performance  is  discussed  in  detail,  including  how  the  measures  were  used.  Data  can  be 
monitored  without  being  an  actual  performance  measure.  "The  challenge  for  most  leaders  is  to 
examine  all  their  data  and  weed  out  the  inappropriate  measures  from  the  appropriate  ones" 
(Chang  &  DeYoung,  1995,  p.7).  This  analysis  determines  whether  the  measures  of  performance 
are  merely  data,  or  true  performance  measures.  The  MLM  of  Chang  and  DeYoung’s  Measuring 
organizational  impact  (1995)  is  used  as  the  performance  measurement  standard. 

Determining  whether  the  measures  of  performance  used  by  Company  Officers  are  true 
performance  measures  is  a  two  step  process.  First,  criteria  are  generated  from  Chang  & 
DeYoung's  definition  of  a  key  indicator  (KI).  This  criterion  judges  whether  the  individual 
measures  used  by  Company  Officers  are  valid  KIs.  The  operational  use  of  the  KI  is  then 
examined  to  determine  if  the  measure  is  used  in  accordance  with  Chang  &  DeYoung's  MLM. 
The  examination  of  operational  use  includes  an  examination  of  data  collection,  tracking,  and 
feedback  methods.  This  thesis  requires  that  both  of  these  conditions  be  met  if  the  measure  is  to 
be  called  a  true  performance  measure. 

A.  GENERATION  OF  CRITERIA 

The  measurement  linkage  model  (MLM)  is  an  eight-step  procedure  for  an  organizational 
measurement  system.  Within  the  Naval  Academy,  the  Company  Officer  and  Senior  Enlisted  are 
the  equivalent  of  a  Chang  &  DeY oung  workgroup.  Generating  criteria  to  determine  whether  a 
measure  is  a  valid  KI  for  a  workgroup  is  found  in  step  four  of  the  MLM.  According  to  Chang  & 
DeYoung  there  are  two  questions  to  be  answered  when  developing  KIs. 


41 


•  What  concrete  measure  could  be  used  to  show  how  your  work  group  is  doing  on  each 
key  result  area  (KRA)? 

•  What  would  you  point  to  if  your  boss  asked  you  how  you  are  doing  in  each  KRA? 
The  problem  with  these  two  questions  is  that  there  are  no  clear,  formal  KRAs  generated  for  the 
Company  Officers.  The  mission  statement  of  the  Naval  Academy  is  used  to  generate  the  KRAs 
for  this  analysis. 

The  current  purpose  of  the  United  States  Naval  Academy  is  "To  develop  midshipmen 
morally,  mentally  and  physically  and  to  imbue  them  with  the  highest  ideals  of  duty,  honor  and 
loyalty  in  order  to  provide  graduates  who  have  potential  for  future  development  in  mind  and 
character  to  assume  the  highest  responsibilities  of  command,  citizenship  and  government" 
(United  States  Naval  Academy,  1996b,  p.22).  Therefore,  the  assumed  KRAs  are  mental,  moral 
and  physical  development.  Every  Company  Officer  understood  that  their  job  was  to  contribute  to 
the  mental,  moral,  and  physical  development  of  the  midshipmen.  Subsequently,  their  work  group 
KIs  should  operationally  measure  the  company's  progress  in  these  areas. 

The  measures  of  performance  used  by  Company  Officers  at  the  Naval  Academy  are 
evaluated  against  the  following  five  criteria  of  Chang  &  DeYoung.  The  criteria  are 
characteristics  of  effective  KIs.  KIs  must: 

1.  Provide  critical/important  data. 

2.  Be  easily  understood. 

3 .  Be  controllable  by  your  actions. 

4.  Track  actual  performance  change. 

5.  Align  with  existing  data  or  be  clearly  established. 
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6.  Measure  efficiency  (timeliness,  throughput,  quantity,  etc)  or  effectiveness  (impact, 
quality,  contribution,  etc)  (Chang  &  DeYoung,  1995,  p.63). 

All  of  the  above  criteria  must  be  met  for  the  measure  to  be  considered  a  valid  KI. 

Once  a  determination  has  been  made  as  to  a  measure's  validity  as  a  KI,  the  operational 
use  of  the  KI  is  examined.  Those  measures  determined  in  the  previous  step  to  be  valid  KIs  are 
analyzed.  Data  collection  and  tracking,  the  use  of  performance  targets,  and  feedback  are  the  three 
operational  aspects  that  are  examined.  This  three-pronged  examination  will  determine  if  the  KIs 
are  used  in  a  performance  measurement  sense. 

"Collecting  and  tracking  the  KI  data  is  where  'the  rubber  meets  the  road'  and  many 
measurement  attempts  fail"  (Chang  &  DeYoung,  1995,  p.73).  Tracking  and  monitoring  the  data 
is  critical  to  the  success  of  the  performance  measurement  system.  The  following  questions  must 
be  answered  for  the  measurement  data  to  be  used  effectively: 

•  Who  will  collect  it? 

•  How  will  it  be  collected? 

•  Where  Avill  the  data  be  stored  and  posted  so  that  employees  [Company 
Officers/Midshipmen]  can  monitor  their  performance? 

•  When  will  it  be  collected  and  posted? 

(Chang  &  DeYoimg,  1995,  p.73). 

Performance  targets  are  KI  goals  based  on  knowledge  of  the  KI  "baseline."  A  baseline  is 

defined  as  "the  current  level  of  performance  at  which  an  organization,  process,  or  function  is 

operating"  (TRADE,  1995,  p.  A-2).  Chang  &  DeYoung  define  a  baseline  as  more  of  an  average 

level  of  performance  over  time  (1995).  It  is  used  to  set  realistic  performance  targets.  The 

TRADE  group's  performance  measurement  process  does  not  use  a  baseline  in  this  way.  It  merely 
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directs  the  setting  of  attainable  goals.  Chang  &  DeYoung  are  much  more  specific.  They  ask,  if 
you  have  not  measured  your  baseline  how  can  you  set  realistic  performance  targets?  In  keeping 
with  the  MLM,  the  baseline  of  Chang  &  DeYoung  is  used. 

An  example  baseline  fisr  the  KI  of  GPA  would  be  the  cumulative  GP A.  Semester  GPA 
would  be  the  value  of  the  KI  at  a  specific  time,  while  the  cumulative  GPA  is  an  average  built  up 
over  a  longer  period  of  time.  "Setting  improvement  goals  without  knowledge  of  how  a  process  or 
system  is  performing  is  a  prescription  for  disappointment... Gathering  baseline  data  about  the 
performance  of  work  group  processes  and  systems  will  help  leaders  set  realistic  performance 
targets"  (Chang  &  DeYoung,  1995,  p.  79).  The  operational  examination  of  each  KI  analyzes 
whether  performance  targets  and  baselines  were  used. 

Performance  measurement  as  a  tool  of  performance  management  is  a  process  designed  to 
produce  continuous  improvement.  To  obtain  continuous  improvement  there  must  be  feedback 
(TRADE,  1995;  Chang  &  DeYoimg,  1995).  "Without  the  feedback  loop,  no  performance 
measurement  system  will  ever  ensure  an  effective  and  efficient  operation,  and. .  .conformance  to 
customer  requirements"  (TRADE,  1995,  p.1-8).  Chang  &  DeYoung  comment  that  "...you  will 
monitor  the  performance  of  your  work  group  continually.  If  you  complete  the  process  of 
establishing  where  and  how  you  will  post  and  report  the  data,  you  will  have  no  problem  doing 
this.  Employees  will  appreciate  the  continual  feedback  and  will  use  this  information  to  improve 
their  performance"  (1995,  p.99). 

The  key  concepts  are  the  continuous  monitoring,  reporting  back  whether  performance 
targets  were  met  or  not,  and  by  how  much.  In  the  case  of  Company  Officer  KIs,  feedback  can  be 
accomplished  via  punishment,  formal  counseling,  posting  on  bulletin  board,  e-mail,  and  verbal. 
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The  KIs  will  be  operationally  evaluated  based  on  accomplishment  of  continuous  monitoring  and 
effective  feedback. 

To  summarize,  the  measures  of  performance  used  by  Company  Officers  are  examined  in 
two  steps.  In  step  one,  the  measures  are  evaluated  against  six  criteria  from  Chang  &  DeYoung  to 
determine  if  they  are  valid  KIs.  This  data  is  displayed  in  worksheet  format,  followed  by  a 
detailed  explanation.  In  step  two,  the  valid  KIs  are  operationally  examined  to  detenmne  whether 
the  KIs  were  used  in  a  performance  measurement  fashion.  This  involves  collecting  and  tracking 
the  data,  using  baselines  and  performance  targets,  and  feedback. 


B.  KEY  INDICATOR  ANALYSIS 

The  results  of  the  KI  analysis  are  displayed  in  a  table  format  with  the  measures  listed 
down  the  left-hand  column  and  the  criteria  number  across  the  top.  A  detailed  explanation  of  each 
measure  follows  the  worksheet.  This  discussion  elaborates  on  each  measure’s  ability  to  meet  the 
criteria  of  a  valid  KI.  The  assumed  KRA  that  the  particular  measure  operationally  indicates  is 
also  listed  across  the  top. 

Some  measures  do  not  indicate  performance  in  any  of  the  three  assumed  KRAs.  In  that 
case  the  space  in  the  worksheet  is  left  blank.  It  is  not  unusual  for  a  work  group  to  have  additional 
KRAs  that  do  not  link  up  directly  to  the  organization-wide  KRAs.  KRAs  can  be  developed  for  a 
specific  work  group,  independent  of  the  organization,  if  the  work  group  produces  value  added 
major  outputs  that  do  not  directly  support  the  organization-wide  KRAs  (Chang  &  DeYoung, 
1995).  For  instance,  if  Morale  were  a  company  KRA,  attendance  at  company  functions  might  be 
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a  KI  for  that  KRA.  In  this  case,  attendance  at  company  functions  is  not  a  valid  KI  because  it  does 
not  meet  the  six  criteria. 


Key  Indicator  Worksheet 
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The  first  measure  of  performance  examined  is  PRT  Results.  PRT  Results  provide 
important  data  (Cl)  because  it  measures  how  well  a  midshipman  performs  on  the  physical 
readiness  test.  The  data  is  also  easily  understood  (C2).  Each  exercise  repetition  scores  points  for 
the  individual.  The  individual  scores  one  point  per  sit-up  and  push-up,  for  a  maximum  of  100 
points  in  each  exercise.  A  1.5-mile  run  is  then  timed  and  points  are  given  based  on  time.  The 
shorter  the  time  to  run  the  1 .5  miles,  the  higher  the  points.  The  score  is  controllable  by  the 
midshipman's  actions  to  the  extent  that  he  or  she  works  out  regularly  and  stays  physically  fit 
(C3).  Improvements  in  the  score  track  an  actual  performance  change  because  it  is  impossible  to 
do  better  if  you  are  not  more  physically  fit  (C4).  PRT  Results  align  with  existing  data  because 
the  Physical  Education  Department  already  administers  and  scores  the  test.  They  also  monitor 
the  result  (C5),  regardless  of  whether  Company  Officers  track  the  scores,  because  the  PRT  score 
is  factored  into  the  midshipman's  PE  grade.  The  test  measures  the  quality  of  the  midshipman's 
physical  readiness,  which  is  effectiveness  (C6).  PRT  Results  indicate  a  measure  of  performance 
in  the  KRA  of  physical  development  and  according  to  the  criteria,  a  valid  KI. 

PE  Grades  are  another  valid  KI.  Midshipmen  take  classes  in  boxing,  swimming, 
volleyball,  weight  lifting,  basketball,  and  others.  A  midshipman's  physical  education  grade 
provides  a  critical  measure  of  how  well  the  midshipman  is  performing  in  the  KRA  of  physical 
development  (Cl).  Grades  awarded  are  A,  B,  C,  D,  F  and  I  (incomplete).  These  grades  are  easily 
imderstood  (C2)  and  align  with  existing  Physical  Education  Department  data  (C5).  The  instructor 
gives  the  midshipman  a  grade  whether  or  not  the  Company  Officer  monitors  it.  The  grade  is 
controllable  by  the  midshipman's  action  (C3)  in  that  with  increased  effort  and  attention,  a 
midshipman  should  be  able  to  increase  their  grade.  In  effect,  this  would  also  track  a  performance 
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change,  because  a  change  in  effort  and  attention  should  result  in  a  change  in  PE  grade  (C4).  PE 
grades  also  measure  the  quality  of  each  student's  effort  and  the  result  of  that  effort  (C6). 

GPA  provides  critical  data  and  is  almost  self-explanatory.  Grade  point  average  is  a  total 
measure  of  the  student's  academic  performance  in  all  classes.  Midshipman  cannot  graduate  if  the 
cumulative  GPA  is  below  2.0.  It  also  measures  the  current  academic  performance  of  the 
midshipmen  in  the  company  (Cl).  It  is  easily  understood  and  tracks  with  existing  data,  as  grades 
are  assigned  A,  B,  C,  D,  F,  and  I  (incomplete)  (C2/C5).  The  midshipman's  effort,  intelligence, 
and  enthusiasm  control  GPA.  An  increase  in  any  of  those  areas  should  result  in  a  change  in 
performance  (C3/C4).  GPA  also  measures  the  midshipman's  effectiveness  at  obtaining  a  certain 
GPA(C6). 

GPA  delta  is  the  difference  between  a  midshipman's  current  GPA  and  his  cumulative 
GPA.  This  does  not  provide  critical  data  (Cl).  The  other  five  criteria  are  met  as  with  GPA.  The 
data  is  easily  understood  (C2),  controllable  by  the  midshipmen  actions  (C3),  and  tracks  an  actual 
academic  performance  change  (C4).  GPA  delta  also  aligns  with  existing  data  since  GPA  is 
computed  by  the  Naval  Academy  every  six  weeks  during  the  semester. 

The  problem  with  GPA  delta  is  that  GPA  provides  all  the  GPA  data  you  would  need.  If 

GPA  is  used  in  a  performance  measurement  fashion,  as  a  KI,  then  GPA  delta  is  already  taken 

into  accoimt.  It  would  be  the  difference  between  the  baseline  GPA  and  actual  semester  GPA. 

However,  the  difference  between  the  performance  target  GPA  and  actual  semester  GPA  would 

be  more  important  in  a  performance  measurement  system.  GPA  delta  is  a  piece  of  information, 

not  a  performance  measure.  There  are  a  number  of  variables  not  taken  into  account,  which 

relegate  it  to  data  status  only.  GPA  delta  does  not  take  into  account  the  number  of  credit  hours 

taken,  the  course  load  for  a  particular  semester,  or  anything  else  that  might  be  going  on  in  the 
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midshipman's  semester.  These  factors  would  be  taken  into  account  by  the  GPA  performance 
target  for  that  semester.  The  sole  purpose  of  GPA  delta  today  is  to  indicate  a  trend  in  academic 
performance,  either  positive  or  negative.  The  midshipmen  use  it  only  to  gain  an  extra  weekend 
(United  States  Naval  Academy,  1998c).  GPA  properly  used  as  a  KI,  would  take  all  of  this  into 
account.  Any  effort  expended  on  GPA  delta  is  then  just  duplicated  effort.  For  these  reasons,  GPA 
delta  is  not  a  valid  KI. 

Absences  provide  critical  data  (Cl)  because  midshipmen  are  not  allowed  to  miss  class.  It 
is  their  duty  to  go  to  class.  To  support  this  requirement  the  Commandant's  Staff  did  a  study.  A 
strong  correlation  was  found  in  1997  between  company  absences  and  company  GPA.  The 
companies  with  the  highest  absenteeism  had  the  lowest  grades. 

Absences  are  easily  understood  (C2).  The  professor  takes  roll  when  class  begins.  He  later 
enters  the  absent  or  tarde  (late  for  class)  midshipmen  into  a  computer  database.  The  Company 
Officers  have  access  to  this  data  via  their  office  computers.  The  midshipmen  then  report  a 
reason,  which  is  entered  into  the  computer.  Available  choices  include  unauthorized  absence 
(UA),  Medical/Dental,  movement  order/excusal,  and  Sup/Dant  meeting.  A  movement  order  is  an 
approved  organized  movement  of  midshipmen  for  some  purpose,  including  varsity  sporting 
events,  community  service,  and  class  trips.  A  meeting  with  the  Superintendent  of  the  Naval 
Academy  or  Commandant  is  abbreviated  Sup/Dant  Meeting. 

Midshipmen  control  absence  (C3).  They  can  choose  to  attend  class  or  not,  and  face  the 

consequences.  Absences  track  a  performance  change  (C4)  when  they  begin  to  accrue. 

Unauthorized  absences  are  the  most  tracked  as  they  represent  disobedience  or  laziness. 

Movement  order  ^O)  absences  become  critical,  in  the  case  of  athletes,  when  grades  begin 

falling.  Increased  MO  absences  with  falling  grades  might  signal  the  need  to  have  that  athlete  stay 
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behind  and  study,  instead  of  missing  class.  Absences  align  easily  with  existing  data  because  there 
is  already  a  system  in  place  to  track  them.  The  updated  computer  system,  from  a  time  sharing 
network  to  a  web-based  server  with  an  ORACLE  database,  has  made  absences  easier  to  track. 
Absences  measure  both  the  midshipman's  efficiency  at  getting  to  class  on  time,  as  well  the 
Company  Officer’s  effectiveness  at  ensuring  that  the  midshipmen  attend  class  (C6).  For  all  of 
these  reasons  Absences  are  determined  to  be  a  valid  KI. 

Honor  offenses  do  not  provide  critical  or  important  data  at  the  company  level  (Cl).  The 
number  of  honor  offenses  is  so  small  in  any  particular  company  that  they  are  looked  on  as 
anomalies.  This  does  not  mean  that  an  honor  offense  does  not  warrant  Company  Officer 
attention,  but  the  number  of  honor  offenses  committed  in  a  given  company  each  year  is  not 
significant.  The  number  of  honor  offenses  is  more  significant  on  the  Brigade  level,  where  the 
numbers  are  higher.  It  would  be  more  appropriate  as  an  organization-wide  KI  for  the 
Commandant's  Staff  than  for  a  particular  company. 

The  data  is  easily  understood  (C2)  as  only  one  or  two  honor  offenses  are  committed  per 
company  per  year.  It  is  also  controllable  by  midshipman  action  (C3).  The  midshipmen  decide 
whether  or  not  to  lie,  cheat  or  steal.  The  number  of  honor  offenses  does  not  track  an  actual 
performance  change  (C4).  The  number  of  honor  offenses  can  be  clearly  established  (C5),  but  as 
previously  discussed,  is  of  little  significance.  The  number  of  honor  offenses  does  not  measure  the 
efficiency  or  effectiveness  of  anything  in  the  company.  On  the  brigade  level,  however,  it  would 
indicate  the  effectiveness  of  the  honor  concept  (C6).  For  these  reasons  the  number  of  honor 

offenses  is  not  a  valid  KI  for  the  Company  Officer. 

The  number  of  questions  to  honor  representatives  (reps)  is  also  not  a  valid  KI  and 

contains  no  critical  data  (Cl).  A  case  might  be  made  that  it  shows  an  interest  in  the  honor 
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concept,  but  performance  change  (C4)  has  not  been  shown  to  result  from  a  specific  number  of 
questions  in  a  given  time  period.  Although  the  data  is  easily  understood  (C2)  as  a  straightforward 
number  of  questions,  performance-related  information  is  not  present  in  that  number.  The 
midshipmen  control  the  number  of  questions  (C3).  Although  existing  data  is  not  available  to 
Company  Officers,  the  number  of  honor  questions  can  be  clearly  established  (C5).  The  company 
honor  reps  would  have  to  keep  track  of  how  many  questions  they  were  asked  over  a  period  of 
time.  The  number  of  honor  questions  does  not  measure  either  efficiency  or  effectiveness  (C6); 
the  number  of  honor  questions  is  not  a  valid  KI. 

Extra  instruction  (El)  hours  are  not  a  valid  KI.  Although  El  hours  provide  useful 
information  to  the  Company  Officer,  it  is  not  critical  data  (Cl)  that  indicates  how  the 
midshipman  is  performing  in  the  KRA  of  mental  development.  Some  Company  Officers  called 
the  El  tracking  sheets  "the  weekly  honor  offense,"  because  if  one  mandates  that  midshipmen 
attend  a  certain  amount  of  El  hours  with  their  professor,  their  tracking  sheets  would  have  those 
exact  hours.  This  is  not  meant  to  imply  that  all  midshipmen  lie  weekly  on  their  tracking  sheets, 
but  to  illustrate  the  weekly  potential  for  an  honor  offense.  However,  academic  performance  did 
not  necessarily  increase  due  to  increased  El  (C4).  El  hours  are  easily  understood  (C2)  and 
controllable  by  the  midshipmen  (C3).  Midshipmen  schedule  extra  instruction  with  the  professor, 
attend  the  session  and  then  record  the  El  hours  on  an  academic  tracking  sheet  for  the  week. 

El  hours  align  with  existing  data  (C5)  as  a  measure.  Many  midshipmen  are  already 
required  to  submit  these  academic  tracking  sheets  by  their  Company  Officers.  Most  of  those 
required  to  submit  the  tracking  sheets  were  either  a  plebe  or  unsat.  A  midshipman  is  unsat  if  he 
or  she  meets  any  of  the  following  conditions:  GPA<2.0, 2  Ds,  or  one  F  in  any  grading  period.  El 

hours  do  not  measure  either  efficiency  or  effectiveness  (C6);  El  hours  are  not  a  valid  KI. 
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The  number  of  Ds  and  Fs  in  performance  is  also  not  a  valid  KI.  The  number  of  people  in 
a  company  getting  a  D  or  F  in  military  performance  is  insignificantly  low  (Cl).  It  is  maybe  one 
or  two  people  a  year.  Many  companies  do  not  give  anyone  a  D  or  F  in  performance  at  all.  Also, 
for  someone  to  get  a  D  or  an  F  there  are  other  indicators  of  the  problem.  The  D  or  F  is  the  result 
of  failing  to  perform.  There  are  other  KIs  that  better  indicate  substandard  performance.  The 
number  of  Ds  and  Fs  in  performance  would  be  a  number  that  is  easily  understood  (Cl), 
controllable  by  the  midshipmen  (C3),  and  tracks  an  actual  performance  change  (C4).  It  does  not 
align  with  existing  data,  but  could  be  clearly  established  (C5),  if  the  measure  was  desired.  The 
number  of  Ds  and  Fs  in  performance  does  not  measure  the  efficiency  or  effectiveness  (C6)  of 
anything  in  the  company.  Because  it  does  not  satisfy  the  criteria  the  number  of  Ds  or  Fs  in 
military  performance  is  not  a  valid  KI. 

The  number  of  midshipmen  attending  academic  boards  (Ac  Boards)  is  also  not  a  valid  KI 
for  Company  Officers.  Midshipmen  are  screened  by  the  Ac  Board  if  they  are  deficient  in  some 
area,  including  academics,  physical  qualification  (medical),  alcohol  rehabilitation,  and  physical 
education  (PE  or  PRT)  (United  States  Naval  Academy,  1998a).  This  applies  to  a  very  small 
number  of  midshipmen  in  each  company  (1-5  per  year). 

The  number  of  Ac  Board  cases  is  redundant  as  a  performance  measure  because  a 
midshipman  must  already  be  deficient  in  some  area  to  get  screened  by  the  Ac  Board.  Therefore, 
the  number  of  midshipmen  screened  by  the  Ac  Board  does  not  provide  critical  data  (Cl). 
Although  the  data  is  easily  understood  (Cl),  it  is  not  directly  controllable  (C3).  Once  the 
deficiency  occurs  (which  is  already  indicated  by  another  KI)  the  Ac  Board  will  screen  the  case. 

The  number  of  midshipmen  being  screened  by  an  Ac  Board  does  not  necessarily  track  a 

performance  change  (C4).  The  midshipman  could  have  been  unsat  for  one  to  two  semesters 
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before  the  Ac  Board  reviews  his  case.  A  midshipman  could  have  been  failing  PRTs  since 
arriving  at  the  Naval  Academy  (consistent  performance),  but  will  not  be  reviewed  by  the  Ac 
Board  until  the  third  failure  (United  States  Naval  Academy,  1998e).  There  is  no  existing  data  at 
the  Company  level  for  the  number  of  midshipmen  who  are  screened  for  an  Ac  Board,  but  a 
number  could  easily  be  established  (C5).  It  could  be  argued  that  the  number  of  midshipmen 
screened  for  Ac  Boards  measures  the  effectiveness  (C6)  of  the  company  academic  program, 
however  there  are  too  many  reasons  for  attending  an  Ac  Board  for  the  measure  to  directly  relate. 
There  are  better  measures  that  have  already  been  discussed.  It  would  be  a  redundant  measure. 
Therefore,  the  number  of  midshipmen  screened  for  an  Academic  Board  is  not  a  valid  KI. 

All  midshipmen  are  weighed  once  each  semester.  The  midshipman's  weight  is  checked 
against  height  to  verify  compliance  with  the  Navy's  height-weight  standards.  Midshipmen 
determined  to  be  outside  the  Navy's  height-weight  standards  are  immediately  measured  for 
percent  body  fat  and  classified  into  one  of  five  categories  (United  States  Naval  Academy, 
1998d).  These  categories  are  shown  below. 

I.  Satisfactory,  i.e.,  within  weight  standards. 

n.  Satisfactory,  outside  of  weight  standards  but  within  body  fat  standards 
22%  for  males,  33%  for  females). 

ITT  Satisfactory  during  an  interim  period  because  of  varsity  athletic 

requirements.  All  midshipmen  on  the  team  roster  are  eligible  for  category 
ITT  waivers  regardless  of  in-season  or  out-of-season  status.  The  Deputy 
Commandant  must  approve  waiver  requests. 

IV.  No  longer  used. 
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V. 


Unsatisfactory  (weight  and  body  fat  percentage  exceed  maximum 
standards). 

VI.  Satisfactory,  but  in  a  special  monitoring  program  after  removal  from 
category  V  or  VII. 

Vn.  Unsatisfactory  (underweight,  with  a  minor  or  major  problem). 

(United  States  Naval  Academy,  1998d,  p.2). 

The  number  of  midshipmen  in  Cat5  per  company  is  typically  between  zero  and  five. 
There  are  too  many  variables  that  factor  into  a  person  being  overweight  to  use  such  a  small 
number  as  an  accurate  measure  of  company  performance.  A  number  that  small  can  not 
accurately  measure  the  effectiveness  of  the  company’s  physical  development  (C6).  This  does  not 
diminish  the  importance  of  someone  remediating  out  of  Cat  5  but  it  also  does  not  provide  critical 
information  (Cl)  about  company  performance  in  the  Physical  KRA.  Because  the  number  of 
affected  midshipmen  per  company  is  small,  Company  Officers  are  individually  aware  of 
everyone  that  is  in  Cat5  or  6.  This  means  the  data  is  both  easily  understood  (C2)  and  clearly 
established  (C5). 

According  to  the  Naval  Academy  “. .  .weight  problems  are  caused  by  improper  diet  in 
relation  to  physical  activity. . .  [and]  . .  .midshipmen  will  be  held  accountable  for  remaining  within 
weight  standards”  (United  States  Naval  Academy,  1998d,  p.l).  Therefore,  the  Naval  Academy’s 
position  is  that  weight  control  is  controllable  by  midshipmen  actions  (C3).  Going  from  category 
5  to  category  6  requires  a  change  in  physical  activity  and  dietary  habits  (United  States  Naval 
Academy,  1998d).  Therefore  a  change  in  the  number  of  midshipmen  in  Category  5  does  indicate 
a  change  in  performance  (C4)  of  those  midshipmen. 
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The  number  of  midshipmen  in  weight  control  category  5  &  6  (Cat  5/6)  is  not  a  valid 
Company  Officer  KI.  The  number  of  midshipmen  in  weight  control  category  5  &  6  might  be  a 
valid  organizational  KI  for  either  the  Naval  Academy  as  a  whole,  or  the  P.E.  Department’s 
weight  control  program.  Over  the  entire  Brigade  the  number  of  affected  midshipmen  in  Cat  5/6 
would  be  large  enough  to  provide  meaningful  data  (Cl)  and  measure  the  effectiveness  of  the 
weight  control  program  (C6). 

Midshipmen  get  injured,  sick,  and  undergo  surgery  while  at  the  Naval  Academy.  Either 
the  Physician  or  the  Corpsman,  whoever  treated  them,  will  write  out  a  “chit”  to  the  Company 
Officer.  This  chit  is  a  reconunendation  from  the  medical  department  regarding  the  care  of  the 
midshipman,  and  explaining  the  extent  to  which  the  midshipman  may  exert  himself  The 
recommendation  may  include  anything  from  total  bed  rest  (SIR)  to  excusal  from  drill.  It  can 
inform  the  Company  Officer  that  the  midshipman  has  the  flu  and  requires  bed  rest  or  that  the 
midshipman  underwent  shoulder  surgery  and  can  only  wear  “white  works.”  White  works  is  a 
loose  fitting,  white  jumper,  similar  to  the  Naval  enlisted  white  jumper.  It  is  only  a 
recommendation  though;  the  Company  officer  ultimately  decides  the  extent  of  the  midshipman’s 
participation  in  the  daily  routine. 

The  number  of  Sick-in-Room  (SIR)  chits  represents  the  number  of  company  chits  written 

that  excuse  a  midshipman  from  all  activities,  including  class.  This  is  only  done  in  case  of  illness 

or  surgery.  The  number  of  SIR  chits  is  usually  a  memorably  low  number,  unless  there  is  an 

outbreak  of  sickness.  This  means  the  data  would  be  easily  understood  (C2).  The  number  of  SIR 

chits  provides  no  critical  performance  data  (Cl)  to  the  Company  Officer.  The  number  of  SIR 

chits  is  as  uncontrollable  as  illness  (C3).  Contracting  an  illness  does  not  involve  either  positive  or 

negative  performance,  so  there  is  no  performance  to  track  (C4).  The  Company  Officer  must  sign 
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approval  of  all  Medical  chits,  therefore  the  number  of  SIRs  are  easily  established  (C5).  The 
number  of  SIR  chits  does  not  measure  either  the  efficiency  or  effectiveness  (C6)  of  any  company 
run  program.  For  all  these  reasons  the  number  of  SIR  chits  is  not  a  valid  KI. 

Midshipmen  attendance  at  company  functions  is  also  not  a  valid  KI  for  the  Company 
Officer.  Although  not  falling  under  any  of  the  three  assumed  KRAs,  there  could  be  another  KRA 
at  the  company  level  for  Morale.  This  measure  however,  could  only  serve  as  a  gross  indicator  of 
Morale.  If  a  large  percentage  of  the  company  was  consistently  not  attending  company  functions, 
it  could  signal  a  morale  issue.  It  could  also  mean  the  specific  event  was  poorly  planned  on  a  busy 
weekend.  Midshipmen  have  a  lot  of  competing  interests,  so  getting  all  of  them  together  on  their 
own  liberty  time  is  a  tough  accomplishment.  To  use  the  fact  that  they  might  have  other  things  to 
do  on  their  own  liberty  time  as  a  measure  of  morale  would  not  be  an  accurate  measure. 

Only  one  of  the  criteria  for  a  valid  KI  is  satisfied.  The  attendance  at  company  functions 
can  be  clearly  established  (C5).  A  muster  could  be  taken  which  would  fulfill  the  requirement  for 
measuring  attendance,  but  this  would  probably  produce  a  negative  effect.  The  company  would 
get  the  impression  that  it  was  “mandatory  fun.”  Attendance  at  company  functions  does  not 
provide  critical  data  about  the  company’s  performance  (Cl).  If  all  of  the  midshipmen  were 
present  on  their  own  liberty  time  at  a  voluntary  event  it  probably  means  that  morale  is  good.  To 
infer  any  relationship  fi'om  this  has  no  basis. 

The  number  of  competing  interests  and  po§sible  excuses  would  make  the  data  very  hard 

to  understand  (C2).  Priorities  would  have  to  be  examined  and  weighed  against  attendance  at  the 

company  function  for  all  of  those  who  did  not  attend.  Company  attendance  at  voluntary  events  is 

not  controllable  (C3)  by  anyone.  It  is  based  on  each  individual’s  priorities  for  that  day. 

Attendance  at  company  functions  does  not  track  an  actual  performance  change  (C4).  Because  a 
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relationship  does  not  exist  from  full  attendance  to  zero,  attendance  would  not  track  an  actual 
performance  change  in  Morale.  Where  would  the  line  be  drawn?  How  does  90  percent  of  the 
company  showing  up  at  a  company  function  compare  to  75  percent?  Did  morale  decrease  by  15 
percent?  If  attendance  was  consistently  low  it  might  indicate  a  gross  morale  problem,  but  it  will 
not  track  a  morale  problem.  Attendance  at  company  functions  also  does  not  measure  the 
efficiency  or  effectiveness  of  anything  (C6).  For  all  of  these  reasons  attendance  at  company 
fiinctions  is  not  a  valid  KI. 

Drill  performance  is  a  valid  KI  for  the  Company  Officer.  It  provides  critical  or  important 
data  to  the  Company  Officer  about  the  company’s  performance  in  drill  (Cl).  The  company’s 
performance  is  scored  on  a  scale  of  100  and  then  ranked  against  the  other  companies  in  the 
Brigade.  This  makes  the  data  easily  understood  (C2),  aligned  with  existing  data  (C5),  and 
tracked  as  an  actual  performance  change  (C4).  A  case  could  be  made  that  week  to  week  the 
rankings  done  by  the  midshipmen  are  not  that  accurate.  Some  Company  Officers  referred  to  drill 
rankings  done  by  the  midshipmen  as  a  “crapshoot.”  Company  Officers  compensated  for  this  by 
getting  the  raw  data  from  the  graders  to  see  the  actual  mistakes.  In  reality,  since  the  graders  are 
the  same  for  the  entire  semester  and  rotate  through  different  companies,  the  differences  in 
graders  should  balance  but. 

The  drill  grade  is  controllable  by  midshipmen  actions  (C3).  If  the  midshipmen  practice, 
or  even  focus  more  while  drilling,  their  performance  grade  will  increase.  Drill  performance 
measures  the  effectiveness  of  the  company  (C6)  at  drill  because  it  measures  the  quality  of  their 
performance.  Drill  performance  satisfies  all  six  criteria  and  is  a  valid  KI. 

It  is  mandatory  that  midshipmen  participate  in  at  least  one  athletic  team  per  season. 

Participation  can  be  on  a  varsity  sport  team,  approved  club  sport,  or  an  intramural  sport.  There  is 
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a  difference  between  monitoring  midshipmen  intramural  success  and  tracking  it  as  a  performance 
measure.  Company  Officers  should  track  how  the  company  teams  are  performing  by  attending  as 
many  intramural  games  as  possible.  Intramural  success  however  provides  no  critical  data  (Cl) 
about  the  physical  development  KRA. 

A  win-loss  record  is  easy  to  understand  (C2)  as  data,  but  it  says  nothing  about  how  the 
midshipmen  are  developing  physically.  The  fact  that  the  midshipmen  show  up  and  compete  does 
more  for  their  physical  development  than  the  team’s  record.  How  midshipmen  perform  as  a  team 
is  controllable  by  their  actions,  but  the  overall  outcome  is  not  (C3).  If  they  play  a  better  team, 
they  get  defeated  so  intramural  success  does  not  track  an  actual  performance  change  (C4).  The 
team  can  work  and  practice  harder  and  still  is  beaten.  They  are  not  professional  athletes.  They 
are  midshipmen  who  did  not  go  out  for  any  other  sport. 

Intramural  success  aligns  with  existing  data  (C5)  because  all  intramural  game  results  are 
published  the  next  day  in  e-mail  to  all  staff  The  data  however,  does  not  measure  the  efficiency 
or  effectiveness  of  any  physical  development.  For  all  of  these  reasons,  the  success  of  company 
intramural  teams  is  not  a  valid  KI. 

Morale  is  a  poor  key  indicator.  It  satisfies  only  one  of  the  criteria  from  Chang  & 
DeYoung’s  MLM.  The  morale  measurement  is  easily  understood  (C2)  because  it  is  on  a  4.0 
scale.  The  Company  First  Sergeant  derives  the  measure  on  his  or  her  own.  It  is  a  subjective 
measure  of  morale  based  on  feedback  to  the  first  sergeant  during  the  week.  This  is  not  a 
company  poll  of  everyone  in  the  company,  but  a  number  that  the  First  Sergeant  generates.  It  is 
based  on  impressions  of  where  he  or  she  thinks  morale  is  on  the  scale.  This  measurement  does 
not  provide  critical  or  important  data  (Cl).  The  feedback  that  accompanies  the  assessment  of 
morale  is  more  important  because  it  contains  specific  midshipmen  concerns.  These  concerns  can 
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then  be  assessed  and  acted  on.  The  measurement  of  morale  was  not  controllable  by  anyone’s 
action  (C3)  because  no  specific  criteria  are  assigned.  The  measurement  does  not  track  a 
performance  change  (C4)  or  align  with  existing  data  (C5).  The  measurement  of  morale  did  not 
measure  the  efficiency  of  effectiveness  of  anything  (C6).  With  only  one  of  the  criteria  met  the 
measurement  of  morale  is  not  a  valid  KI. 

C.  OPERATIONAL  USE 

The  previous  analysis  determined  that  five  Company  Officer  measures  of  performance 
are  valid  KIs.  The  measures  that  met  all  six  criteria  are  PRT  Results,  PE  grades,  GPA,  Absences, 
and  Drill  performance.  Because  a  measure  is  determined  to  be  a  valid  KI  does  not  mean  that  it 
was  used  as  a  KI.  These  five  KIs  must  be  examined  to  see  if  and  how  they  were  used  in  a 
performance  measurement  sense.  This  examination  is  termed  an  operational  analysis. 

The  operational  analysis  of  the  KI  determines  if  the  measure  is  used  in  accordance  with 
Chang  &  DeYoung's  MLM.  Data  collection,  tracking,  the  use  of  baselines  and  performance 
targets,  and  feedback  methods  are  all  examined  as  part  of  this  analysis.  It  begins  with  an 
examination  of  the  data  collection  and  tracking  methods  of  each  KI.  The  following  questions 
must  be  answered  for  the  measurement  data  to  be  used  effectively: 

•  Who  will  collect  it? 

•  How  will  it  be  collected? 

•  Where  will  the  data  be  stored  and  posted  so  employees  [Company 
Officers/Midshipmen]  can  monitor  their  performance? 

•  When  will  it  be  collected  and  posted? 

(Chang  &  DeYoung,  1995,  p.73). 
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Once  those  questions  have  been  answered  satisfactorily  the  use  of  baselines  and 
performance  targets  are  examined.  Were  baselines  and  performance  targets  used?  How  were  they 
used?  How  often  were  they  used?  These  questions  are  answered  for  each  of  the  five  valid  KIs. 
Next,  the  use  of  feedback  is  examined.  Questions  such  as  “was  feedback  utilized?  How  was  it 
utilized?  And  was  it  effective”  are  answered. 

The  operational  analysis  shows  whether  Company  Officers  have  used  performance 
measurement  principles  in  the  conduct  of  their  duties.  It  is  not  meant  to  be  a  critical  analysis  of 
the  Company  Officers.  Every  Company  Officer  interviewed  was  forthright,  helpful,  and  did  his 
or  her  best  to  ensure  that  I  understood  how  each  particular  measure  was  used.  This  analysis 
illustrates  whether  the  measures  were  used  in  an  effective  performance  measurement  system. 

The  first  KI  to  be  examined  is  PRT  Results.  The  Physical  Education  department  collects 
PRT  Results  following  the  administration  of  the  test.  Proctors  use  muster  sheets  with  the  names 
of  those  examined.  Midshipmen  report  their  scores  to  the  proctors  after  each  phase  of  the  exam. 
The  scores  are  then  kept  by  the  P.E.  department  until  it  is  time  for  grades  to  be  assigned  at  the 
end  of  the  semester.  Company  Officers  do  not  get  a  report  of  the  scores  fi-om  the  P.E. 
department.  The  PRT  scores  are  not  “posted”  as  Chang  &  DeYoung  would  term  it.  The  scores 
are  available  only  to  the  PE  department  at  that  time.  The  PE  department  enters  the  grades  into  the 
Naval  Academy  time-sharing  (NATS)  computer  network,  a  system  that  is  currently  being 
replaced. 

Company  Officers  are  immediately  concerned  about  who  in  the  company  has  failed  the 

PRT.  They  determine  who  has  failed  via  two  methods.  The  first  method  has  the  midshipmen 

report  their  scores  to  the  company  P.E.  Officer,  a  midshipman.  The  second  method  is  to  wait  for 

the  weekly  Company  Deficiency  Report  (Codeffep)  from  the  PE  department.  This  lists  all  PE 
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deficiencies  for  the  company  on  one  sheet.  The  Codeffep  lists  only  P.E.  deficiencies.  The 
Company  Officer’s  concern  is  due  to  the  fact  that  midshipmen  who  fail  the  PRT  have  their 
liberty  restricted.  They  cannot  take  weekends  off  if  they  received  less  than  a  C  on  the  PRT.  The 
Company  Officer  is  held  accountable  for  enforcing  this. 

Midshipmen  who  fail  begin  a  period  of  remediation.  They  muster  at  0530  four  days  a 
week  for  “conditioning  squad”  workouts  until  they  pass  the  PRT.  The  Company  Officers  then 
track  daily  the  attendance  at  those  workouts.  A  list  is  e-mailed  out  daily  to  all  Commandants’ 
Staff,  fi'om  the  PE  department,  with  the  names  of  any  midshipmen  not  present  at  assigned 
conditioning  squad.  Company  Officers  are  responsible  for  holding  midshipmen  accountable  for 
unauthorized  absences  fi'om  conditioning  squad. 

Not  one  Company  Officer  interviewed  used  baselines  for  PRT  results.  The  only 
performance  target  mentioned  was  to  pass  the  PRT  on  the  first  time.  This  is  due  in  part  to  the 
nature  of  the  system.  The  PRT  is  given  right  at  the  beginning  of  each  semester  (United  States 
Naval  Academy,  1998e).  This  makes  it  logistically  impossible  for  the  Company  Officer  to 
compute  a  baseline,  and  together  with  each  of  his  132  midshipman,  set  individual  performance 
targets  prior  to  the  PRT.  The  defeult  performance  target  for  the  midshipmen  becomes  passing  the 
PRT  since  the  Company  Officer  cannot  meet  with  all  the  midshipmen  prior  to  the  test  and 
because  there  are  penalties  when  the  midshipman  fail  the  PRT. 

The  Company  Officers  utilized  a  few  different  methods  of  performance  feedback  to  the 

midshipmen.  There  are  also  some  methods  of  feedback  inherent  in  the  system.  Some  Company 

Officers  would  factor  the  PRT  grade  into  the  midshipmen’s  military  performance  grade  to  either 

reward  or  penalize  the  midshipmen  for  PRT  performance.  Others  would  only  penalize  poor 

performers  either  by  withholding  key  positions  in  the  company  or  not  awarding  good  military 
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performance  grades.  Most  Company  Officers  would  track  the  conditioning  squad  attendance  list. 
Feedback  was  via  a  form  2  (punishment)  for  not  attending  the  daily  workout. 

The  Naval  Academy  system  mandates  both  rewards  for  good  performance  and 
punishment  for  poor  performance  on  the  PRT.  This  is  feedback  inherent  in  the  system. 
Midshipmen  who  score  less  than  a  C  on  the  PRT  cannot  take  weekend  liberty.  They  may  take 
town  liberty  until  taps  (usually  0100).  Midshipmen  who  fail  the  PRT  may  not  even  take  town 
liberty  (United  States  Naval  Academy,  1998c).  Midshipmen  who  improve  their  score  by  10 
points  or  more,  or  score  an  ‘A’  on  the  PRT  earn  an  extra  weekend  during  the  semester.  Also 
midshipmen  who  get  an  ‘A’  on  the  first  semester  PRT  do  not  have  to  take  the  second  semester 
one.  To  qualify  for  the  Superintendent’s  List  or  the  Commandant’s  List  a  midshipman  must  have 
scored  at  least  a  ‘B’  on  the  PRT  (United  States  Naval  Academy,  1998c). 

Feedback  to  the  midshipmen  regarding  PRT  results  is  incomplete.  It  does  not  involve  all 
the  midshipmen.  If  you  do  well  enough,  you  are  recognized  and  rewarded  for  it.  If  you  do 
poorly,  you  are  likewise  recogmzed  and  rewarded  for  that.  If  you  perform  in  the  middle  you  are 
not  recognized.  This  is  not  performance  measurement  feedback.  The  best  method  of  feedback 
found,  that  was  equally  applied  to  all  midshipmen  in  a  company,  was  the  factoring  in  of  the  PRT 
score  into  the  military  performance  grade. 

PRT  Results  are  not  operationally  used  as  a  KI.  The  lack  of  use  of  baselines  and 
performance  targets,  coupled  with  the  incomplete  feedback  are  the  main  reasons  for  this 
determination.  Data  collection  and  tracking  could  be  better  accomplished  if  the  Company 
Officers  had  better  access  to  the  PRT  data.  In  a  true  performance  measurement  system  each  and 
every  midshipman  is  counseled  regarding  his  or  her  performance  on  the  PRT.  This  counseling 
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includes  the  computation  of  a  baseline  and  the  setting  of  a  goal  (performance  target)  for  that 
semester.  This  did  not  happen  completely  enough  across  the  spectrum  of  Company  Officers. 

PE  grades  are  the  next  valid  KI  examined.  The  instructors  generate  PE  grades  at  the  end 
of  the  semester.  The  PE  department  collects  the  data  and  stores  it  in  the  NATS  system.  PE  grades 
are  issued  when  final  grades  are  issued.  The  grades  are  not  necessarily  “posted”  anywhere.  If  a 
midshipman  has  failed  P.E.  he  or  she  will  appear  as  a  deficiency  on  the  weekly  codefrep  the 
following  Monday.  No  Company  Officer  actively  tracked  PE  grades  because  there  is  nothing  to 
track.  The  grades  come  out  only  at  the  end  of  the  semester. 

This  does  not  prohibit  the  use  of  PE  grades  as  a  KI.  It  sets  the  “time  for  tracking” 
discussed  by  Chang  &  DeYoung.  “. .  .Each  KI  may  have  its  own  natural  ‘time  for  tracking.  ’  For 
example,  some  KIs  are  tracked  quarterly. . .  and  others  may  be  tracked  monthly.  Use  this  natural 
timing  to  help  determine  when  the  data  will  be  collected  and  posted”  (Chang  &DeYoung,  1995, 
P-75). 

No  baselines  or  performance  targets  were  used  by  any  Company  Officers  with  regard  to 
the  KI  of  PE  grades.  PE  grades  were  examined  for  the  previous  semester  if  at  all.  There  were  no 
Company  Officers  interviewed  that  mentioned  setting  goals  for  PE  class  or  providing  feedback 
after  the  semester  ended. 

Feedback  was  utilized  in  only  a  negative  sense  by  Company  Officers.  As  with  PRT 
results,  there  is  some  system  feedback  also.  Company  Officers  focused  on  the  PE  deficient 
midshipmen.  The  midshipmen  appearing  on  the  weekly  codefrep  receive  all  the  feedback.  Swim 
failures  get  to  go  to  ‘sub  squad’  and  practice  swimming  three  days  a  week.  Attendance  is 
mandatory  and  Company  Officers  are  responsible  for  ensuring  their  midshipmen  attend. 
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The  Naval  Academy  system  rewards  outstanding  performance  as  well  as  punishes  poor 
performance.  A  minimum  of  a  ‘C’  is  needed  in  PE  to  take  weekend  liberty.  A  minimum  of  a  ‘B’ 
is  needed  to  make  either  the  Superintendent’s  or  Commandant’s  List  (United  States  Naval 
Academy,  1998c).  Both  of  these  honors  earn  extra  weekends. 

PE  grades  have  not  been  used  operationally  as  a  KI.  Data  collection  and  tracking  methods 
are  satisfactory.  The  periodicity  of  PE  grades  sets  a  natural  tracking  time  for  this  KI.  This  is 
acceptable.  The  fact  that  no  baselines  or  performance  targets  were  used  for  PE  grades 
operationally  disqualifies  it  as  a  KI. 

The  registrar  collects  GPA  from  all  the  academic  departments  using  the  NATS  system. 
Instructors  input  their  grades  into  the  system  where  they  become  available  for  Company  Officers 
to  review.  The  NATS  system  is  slow,  cumbersome,  and  not  user  friendly.  EMC  (SS)  Canfield, 
one  of  the  company  senior  enlisted  advisers,  has  designed  new  software  using  a  PARADOX 
database.  This  software  installs  on  the  Company  Officer  computer  and  is  much  more  user 
friendly  than  the  NATS  system.  The  PARADOX  software  still  uses  the  NATS  system  as  its 
source  and  the  Chief  must  download  the  data  manually  for  all  thirty  Company  Officers  and 
Senior  Enlisted  at  every  marking  period.  This  personal  effort  notwithstanding,  it  is  an  incredible 
advantage  for  the  Company  Officers. 

The  software,  named  BRIGREAD  PLUS,  displays  all  grades  for  all  classes,  automatically 
computes  weekend  eligibility,  shows  PE  grades  when  complete,  midshipman  personal 
information,  and  has  room  for  Company  Officer  notes.  It  is  called  BRIGREAD  PLUS  because  of 
the  NATS  program  called  BRIGREAD,  which  it  accesses  for  all  the  data.  This  software  is  almost 
unanimously  favored  by  Company  Officers. 
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Baselines  and  performance  targets  were  used  for  GPA.  At  the  simplest  level  baselines 
and  performance  targets  were  used  during  the  mandatory  counseling  that  each  midshipman  has 
with  either  the  Company  Officer  or  Senior  Enlisted.  Most  Company  Officers  would  examine  the 
midshipman’s  past  academic  performance  during  counseling  and  generate  an  academic  semester 
goal  with  the  midshipman.  This  was  usually  done  once  a  semester  with  each  midshipman. 

Feedback  is  conducted  with  each  midshipman  during  counseling.  The  Company  Officers 
would  look  at  the  previous  semester’s  GPA  as  part  of  counseling  and  discuss  the  plans  for  the 
future.  This  was  done  once  a  semester  for  most  midshipmen.  Academically  weaker  or  unsat 
midshipmen  would  get  constant  attention  and  feedback  throughout  the  semester. 

Feedback  from  the  Naval  Academy  system  again  occurs  in  the  form  of  both  rewards  and 
punishments.  These  rewards  and  punishments  are  based  on  academic  performance.  Midshipmen 
may  earn  extra  weekends  by  attaining  either  the  Superintendent’s  (semester  GPA  at  least  3.4)  or 
Commandant’s  List  (semester  GPA  at  least  2.9)  (United  States  Naval  Academy,  1998c). 
Midshipmen  may  also  earn  extra  weekends  if  their  semester  GPA  is  greater  than  0.3  above  their 
cumulative  GPA  (United  States  Naval  Academy,  1998c).  Midshipmen  may  not  take  weekend 
liberty  if  they  are  unsat.  This  means  that  either  their  GPA  is  less  than  2.0,  they  have  2  Ds  or  one 
F  (United  States  Naval  Academy,  1998c). 

GPA  operationally  satisfies  the  criteria  as  a  KI.  The  data  is  collected  and  tracked 
satisfactorily.  The  upgrading  of  the  computer  system  at  the  Naval  Academy  to  an  ORACLE 
database  will  only  improve  this  function.  Baselines  and  performance  targets  were  utilized.  The 
efficiency  and  effectiveness  vary  with  the  counseling  techniques  of  the  Company  Officer,  but  the 
methods  are  sound.  Feedback  is  conducted  by  counseling,  rewards,  and  punishment. 
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Absences  are  collected  by  the  NATS  system.  Professors  input  their  class  absences  after 
each  day.  The  program  is  called  ABSENCE  ***.  Company  Officers  can  access  this  program  to 
check  absences  but  it  is  not  user  friendly.  Most  Company  Officers  felt  forced  to  monitor 
absences  and  take  action  on  midshipmen  who  were  unauthorized  absences  (UA)  from  class.  A 
weekly  absent  report  was  generated  both  at  the  company  level  by  the  company  academic  officer 
(a  midshipman)  and  at  the  Commandant’s  Staff  level  by  one  of  the  Company  Officers.  The  Staff 
report  went  out  to  all  Company  Officers,  Battalion  Officers,  the  Commandant  and  Deputy 
Commandant.  The  midshipmen  did  not  see  the  report,  as  it  was  never  posted. 

Baselines  and  performance  targets  were  not  specifically  used  for  absences  because  the 
default  target  was  zero.  That  is  a  Naval  Academy  system  requirement.  No  unauthorized  absences 
(UAs)  are  permitted  United  States  Naval  Academy,  1998f).  Feedback  was  typically  via 
punishment  but  some  Company  Officers  factored  absences  into  the  military  performance  grade. 
All  UAs  are  punished  in  some  manner.  The  method  varied  depending  on  the  Company  Officer 
and  Battalion  the  company  was  in.  Punishment  for  absences  ranged  from  a  few  demerits  or  extra 
duty  to  restriction  and  loss  of  privileges.  No  one  rewarded  midshipmen  for  going  to  class. 
Performance  measurement  does  not  say  that  midshipmen  should  be  rewarded  for  going  to  class 
either,  only  that  there  should  be  some  feedback  on  the  performance. 

Absences  are  operationally  a  valid  KI  also.  Even  with  the  lack  of  flexibility  in  the 
performance  target  of  zero  absences,  it  was  always  a  stated  goal  to  the  midshipmen.  The  data  is 
collected  satisfactorily,  albeit  not  user  fiiendly.  The  new  computer  system  upgrade  will 
revolutionize  the  way  this  data  is  collected  and  tracked.  There  is  direct  feedback  to  offenders  in 
the  form  of  punishment,  and  also  the  delayed  effect  of  a  reduced  performance  grade.  There  was 

no  evidence  of  any  other  form  of  feedback  to  the  midshipmen  who  attend  class  flawlessly. 
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The  Battalion  And  Company  Drill  Officers  (midshipmen)  collect  drill  performance  data. 
The  data  is  collected  and  compiled  after  every  drill  practice  or  parade.  The  scores  and  rankings 
are  sent  out  via  e-mail  to  all  midshipmen  and  Commandant’s  Staff  following  the  drill  period. 

Baselines  and  performance  targets  were  not  mentioned  by  any  Company  Officers  with 
respect  to  drill.  More  important  to  the  Company  Officers  were  attendance  and  a  proper  muster  at 
drill.  This  is  due  in  part  because  the  Company  Officers  were  directly  held  responsible  for 
midshipmen  attendance  at  drill.  No  Company  Officer  interviewed  hinted  that  there  was  a  goal  for 
drill  or  that  a  certain  amount  of  improvement  was  desired  that  semester. 

The  only  feedback  for  the  KI  of  drill  was  the  e-mail  sent  out  to  the  Brigade  with  the 
results  of  the  particular  drill  period.  At  the  end  of  the  semester  e-mail  is  sent  out  announcing  the 
semester  drill  champion  and  Brigade  rankings.  This  satisfies  the  bare  minimum  of  feedback.  The 
e-mail  sent  to  all  midshipmen  ftilfills  the  same  task  as  posting  it  in  the  passageway,  but  the 
feedback  could  be  done  more  effectively. 

Although  drill  performance  is  a  valid  KI,  in  this  examination  it  was  not  operationally 
used  as  a  KI.  The  lack  of  baseline  data  and  performance  targets  disqualified  the  measure  from 
this  use.  Drill  performance  remains  a  valid  KI  and  could  be  better  utilized. 

To  summarize  then,  there  were  sixteen  measures  that  Company  Officers  monitored  in 
tracking  the  performance  of  their  companies.  Five  of  those  sixteen  were  determined  to  be  valid 
key  indicators  (KIs),  that  is,  indicators  of  performance  in  a  certain  key  result  area  (KRA).  Those 
five  valid  KIs  were  then  operationally  evaluated  to  determine  whether  they  were  used  as  valid 
KIs  in  a  performance  measurement  sense.  Two  of  those  five  met  the  operational  criteria  of  valid 
KIs  in  a  performance  measurement  context.  The  next  chapter  will  summarize  these  findings. 
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draw  conclusions  from  them,  and  make  recommendations  to  maximize  the  effectiveness  of  their 
use. 
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V.  SUMMARY,  CONCLUSION,  AND  RECOMMENDATIONS 
A.  SUMMARY 

This  study  began  with  a  historical  look  at  the  leadership  development  of  midshipmen  at 
the  United  States  Naval  Academy.  The  evolution  of  the  Company  Officer  position  was  examined 
to  illustrate  the  changing  leadership  role.  Company  Officers  have  progressed  from  disciplinarian 
to  adviser  to  leadership  developer  over  the  course  of  their  one  hundred  and  forty-one  year 
existence. 

Today's  Navy  has  become  increasingly  technical  and  complex,  but  the  requirement  for 
strong  leadership  in  combat  situations  has  not  changed.  Cronin  and  Kotter  remind  us  that 
leadership  and  management  are  not  the  same  (1983;  1990).  Joint  Vision  2010  agrees  with  Kotter, 
who  said  that  the  real  challenge  is  combining  strong  leadership  and  strong  management,  using 
each  to  balance  the  other  (1990).  Naval  Academy  graduates  must  possess  the  leadership  and 
management  skills  required  in  dealing  with  change  and  complexity.  New  research  has  shown  that 
our  traditional  methods  of  teaching  these  skills  are  not  as  effective  as  they  could  be  (Senge, 

1990). 

The  concepts  of  Performance  Management  and  Measurement  were  introduced  as  a  means 
of  effectively  capitalizing  on  the  resources  at  the  Naval  Academy  to  develop  leadership  qualities 
in  the  midshipmen  of  today.  Other  research  has  shown  that  because  of  the  nature  of  the  position. 
Company  Officers  are  already  involved  in  performance  measurement  (University  of  California 
at  San  Diego,  1997).  The  purpose  of  this  study  was  to  examine  the  extent  to  which  Company 
Officers  are  using  performance  measurement  techmques. 
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The  analysis  began  with  a  pre-interview  questionnaire  and  interview.  The  purpose  of  the 
interview  was  to  examine  the  methods  that  Company  Officers  use  to  measure  the  performance  of 
their  respective  companies.  These  interviews  produced  sixteen  measures  of  performance. 
Performance  measurement  research  generated  criteria  based  on  a  system  known  as  the 
measurement  Linkage  Model  (MLM)  of  Chang  &  DeYoung.  The  sixteen  measures  of 
performance  were  evaluated  against  the  six  criteria  of  Chang  &  DeYoung  to  determine  whether 
they  were  valid  Key  Indicators  (KIs).  Five  of  the  original  sixteen  measures  were  determined  to 
be  valid  KIs:  PRT  results,  PE  grades,  GPA,  Absences,  and  Drill. 

A  measure  determined  to  be  a  valid  KI  is  not  always  used  as  a  KI.  Chang  &  DeYoung  s 
MLM  was  used  in  the  generation  of  further  criteria  to  satisfy  the  operational  requirement.  The 
five  valid  KIs  were  then  analyzed  against  these  criteria  to  determine  if  they  were  used  in  the 
context  of  performance  measurement.  This  included  utilizing  the  key  aspects  of  any  performance 
measurement  system,  which  are  data  collection  and  tracking,  baselines  and  performance  targets, 
and  effective  feedback.  The  operational  analysis  determined  that  GPA  and  Absences  were  the 
two  valid  KIs  actually  used  in  a  performance  measurement  sense. 

All  of  the  measures  determined  to  be  valid  KIs  remain  good  indicators  of  performance  in 
their  particular  Key  Result  Area  (KRA).  They  need  to  be  used  in  a  performance  measurement 
system  to  obtain  the  maximum  effectiveness. 

B.  CONCLUSION 

The  results  were  not  that  surprising.  Performance  measurement  takes  time,  which 
Company  Officers  do  not  currently  have.  The  Report  of  the  Special  Committee  to  the  Board  of 
Visitors  identified  the  same  time  conflict  in  June  of  1997.  The  Committee,  chaired  by  retired 
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Admiral  Stansfield  Turner  and  Dr.  Judy  Mohraz,  generated  a  report  on  the  ability  of  the  Naval 
Academy  to  fulfill  its  mission.  In  that  five  months  the  Committee  researched,  investigated  and 
analyzed  data  fi’om  focus  groups  across  the  Naval  Academy.  These  focus  groups  included 
Faculty  and  Staff  of  all  ranks,  communities,  and  departments.  It  also  included  midshipmen  fi-om 
the  classes  of  1997  through  2000.  The  Committee  found  that  "The  problem  is  the  nature  of  the 
job  itself  [Company  Officer],  which  includes  competing  responsibilities  to  counsel,  teach,  train, 
discipline  and  evaluate  midshipmen"  (1997,  p.22).  The  report  called  for  the  Academy  to 
"redesign  the  Company  Officer  responsibilities,  placing  particular  emphasis  on  increased  contact 
time  with  the  midshipmen"  (1997,  p.22). 

Increased  contact  time  with  the  midshipmen  is  needed  for  performance  measurement  to 
be  successfiilly  implemented  at  the  Naval  Academy.  Collecting  and  tracking  performance  data, 
generating  baselines  and  performance  targets  with  the  midshipmen  and  feedback  all  require  an 
investment  of  time.  All  Company  Officers  that  were  interviewed  discussed  the  shortage  of  time 
available  for  effective  counseling  and  feedback. 

The  Report  of  the  Special  Committee,  also  known  as  the  Turner  report,  indirectly  calls 
for  performance  measurement  to  be  implemented  at  the  Naval  Academy.  The  report 
recommended  "establishing  a  clear  job  description  supported  by  agreed-upon  measures  of 
success,"  for  the  Company  Officer  (Board  of  Visitors,  1997,  p.23).  The  report  also  indirectly 
discusses  the  use  of  performance  measurement  in  leadership  development.  It  recommends  the 
following  immediate  steps: 

•  Identifying  explicit  leadership  and  professional  development  objectives  for  each 
component  and  ensuring  alignment  of  these  objectives  and  components. 

•  Establishing  measures  of  effectiveness  for  each  component. 
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•  Periodically  capturing,  analyzing,  and  disseminating  data  from  relevant  constituencies 
on  the  strengths  and  weaknesses  and  overall  impact  of  the  program  (Board  of 
Visitors,  1997,  p.21). 

The  most  effective  method  of  accomplishing  these  objectives  is  with  performance 
measurement.  In  the  first  recommendation,  performance  measurement  aligns  organization-wide 
improvement  efforts  by .ensuring  that  individual  work  group  Key  Result  Areas  and  Key 
Indicators  are  linked  with  the  organization's  vision,  mission,  and  strategic  plans"  (Chang  & 
DeYoung,  1995,  p.30).  The  'measures  of  effectiveness'  spoken  of  in  the  second  recommendation 
are  really  measures  of  performance  in  each  of  those  components  [Key  Result  Areas].  Feedback 
and  continuous  improvement  are  emphasized  in  the  third  recommendation. 

This  study  is  not  suggesting  that  the  Naval  Academy  has  ignored  the  Turner  report.  There 
have  been  improvements  in  the  structuring  of  the  Company  Officer  position.  The  most 
significant  is  the  Masters  Program,  which  gives  Company  Officers  a  year  to  earn  their  Masters 
degree  before  they  take  on  the  responsibilities  of  that  position.  Performance  measurement  is  one 
of  the  required  courses  that  incoming  Company  Officers  take  in  the  pursuit  of  their  degree.  This 
should  make  them  more  likely  to  incorporate  performance  measurement  techniques  into  the 
operation  of  the  company,  if  given  the  time. 

This  study  is  suggesting  that  the  Naval  Academy  has  not  gone  far  enough  in  eliminating 
duties  and  responsibilities  that  do  not  contribute  to  the  leadership  development  of  the 
midshipmen  in  company.  Contrary  to  the  Turner  report  recommendation.  Company  Officers  are 
still  required  to  teach  a  leadership  course  each  semester.  A  clear  job  description  supported  by 
agreed  upon  measures  of  success  have  not  been  promulgated  nearly  two  years  after  the  Turner 
report  was  published. 
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C.  RECOMMENDATIONS 


1.  For  the  Naval  Academy 

Assuming  time  constraints  on  Company  Officers  do  not  change,  what  can  be  done  to 
effectively  implement  performance  measurement  techniques?  There  are  several 
recommendations  below  outlining  how  to  better  use  Company  Officer  time  to  effectively  employ 
the  valid  key  indicators.  Most  of  the  recommendations  deal  with  streamlining  processes  to 
increase  efficiency  or  the  collection  and  tracking  of  data. 

PRT  results  could  better  utilize  performance  measurement  techniques  if  the  test  were 
given  later  in  the  semester  so  that  counseling  could  take  place  prior  to  the  event.  If  that  cannot  be 
implemented.  Company  officers  need  to  make  efficient  use  of  post-PRT  counseling.  For  the 
majority  of  Company  Officers,  this  is  the  beginning  of  semester  counseling  and  focuses  mostly 
on  academics  and  post-PRT  failures.  This  counseling  should  involve  computing  a  baseline, 
setting  a  performance  target  for  that  semester,  and  generating  a  strategy  to  accomplish  that  target 
or  goal.  It  is  also  necessary  to  follow  up  with  feedback  after  the  next  PRT  to  obtain  the  full 
effect.  The  problem  with  this  alternative  is  the  long  time  between  counseling  sessions,  coupled 
with  a  break  over  either  Christmas  or  the  summer.  This  tends  to  water  down  the  counseling 
sessions  since  they  have  frequently  happened  months  prior  to  the  exam. 

To  realize  the  full  benefits  of  performance  measurement  the  PRT  data  should  be  more 
accessible  to  Company  Officers.  Currently  the  data  is  hidden  in  the  PE  grade,  which  comes  out  at 
the  end  of  the  semester.  The  new  P.E.  module  for  the  Midshipmen  Information  Data  System 
(MIDS)  is  due  online  in  the  summer  of  1999.  This  should  greatly  effect  the  ease  of  data 
collection  and  tracking. 
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The  deficiency  in  the  use  of  PE  grades  was  the  lack  of  baseline  and  performance  target 
use.  Incorporating  PE  grades  into  early  semester  counseling  however,  will  alleviate  this 
discrepancy.  The  PE  module  on  the  new  computer  system  should  also  make  data  collection 
easier. 

The  method  of  Drill  performance  feedback  was  satisfactory.  E-mail  to  the  Brigade  and 
Staff  directly  informs  all  the  midshipmen  how  they  performed  relative  to  the  rest  of  the  Brigade. 
Drill  performance  was  not  an  operational  KI  due  to  the  lack  of  baseline  and  performance  target 
use.  Effective  counseling  with  the  Drill  Officer  and  an  active  interest  in  the  company's  drill 
performance  will  satisfy  the  operational  requirement  of  a  KI. 

Company  Officer  time  restrictions  not-withstanding,  the  implementation  of  these 
techniques  will  go  a  long  way  toward  maximizing  the  effectiveness  of  Company  Officer 
counseling  and  mentoring,  which  are  two  important  tools  of  leadership  development.  This 
implementation  will  be  made  easier  by  the  Company  Officers  in  the  Masters  Program  and  the 
upgrading  of  the  Naval  Academy’s  computer  system. 

2.  For  further  research 

This  research  touched  on  many  topics  such  as:  leadership,  adult  development, 
performance  management,  and  the  Naval  Academy.  Many  potential  thesis  topics  were  cast  aside 
during  the  narrowing  down  of  the  research  question.  In  addition,  limitations  were  discovered  in 
this  study  as  it  progressed.  The  result  is  that  there  are  many  future  theses  l)dng  latent  in  this  text. 
A  few  are  described  below. 

This  study  only  examined  Company  Officer  measures  fi'om  one  academic  year.  There 
was  only  one  Commandant  in  office  during  the  study.  The  Commandant  has  a  tremendous 
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influence  on  what  the  Company  Officers  consider  important  and  worth  tracking.  In  addition,  the 
interviews  were  done  after  the  academic  year  had  ended,  in  the  summer  of  1998.  If  the 
interviews  had  been  conducted  during  the  academic  year  “in  the  heat  of  battle,”  some  different 
answers  might  have  been  obtained.  The  Company  Officers  would  not  have  had  to  rely  on  only 
their  memory. 

One  of  the  topics  that  surfaced  in  the  research  discussed  the  effects  of  performance 
measurement  systems  on  leadership  decisions.  Both  rational-actor  and  cybernetic  modes  of 
decision  making  were  examined.  Kravchuk  and  Schack  argued  that  increased  reliance  on  formal 
measurement  approaches,  at  the  expense  of  hands-on  management  and  evaluation,  would  place 
leaders  in  a  more  cybernetic  mode  of  decision-making  (1996).  This  means  that  using  the 
measures  as  numbers,  without  understanding  the  relative  importance  of  each  or  how  the  process 
functions,  can  lead  to  faulty  decision-making.  A  study  could  be  done  on  this  at  the  company 
officer  level.  Does  the  quest  for  Color  Company  lead  to  a  more  cybernetic  mode  of  decision 
making?  Do  decisions  get  made  on  the  basis  of  Color  Company  Points  and  not  leadership 
development  of  the  midshipmen  at  the  Company  Officer  level?  Has  the  color  competition  led  to 
more  of  a  cybernetic  mode  of  decision  making  at  the  Naval  Academy?  Any  one  of  these  could  be 
a  thesis. 

The  Color  Company  Competition  itself  could  also  be  examined.  The  Color  Company 
Competition  assigns  weights  to  various  company  endeavors,  such  as  academics,  drill 
performance,  intramurals,  tactical  games,  and  physical  contests.  An  examination  of  the  color 
company  competition  as  a  performance  measurement  system  could  be  conducted  to  answer  the 
question,  "Is  the  CCC  a  valid  performance  measurement  system?" 
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Another  study  could  look  at  other  potential  measures  that  might  be  more  critical  to 
midshipman  development  into  Naval  Officers.  This  thesis  could  also  be  done  on  implementing 
the  MLM  from  the  ground  up.  KRAs  and  KIs  could  be  hypothesized  that  are  not  used  today.  The 
literature  review  could  research  educational  topics,  adult  development  topics,  and  military  topics 
applicable  to  developing  future  Officers. 

A  more  basic  study  should  include  a  follow-on  examination  of  Company  Officer 
measures  of  performance  in  one  to  two  years.  At  that  time  all  Company  Officers  will  be  Masters 
graduates  and  the  new  computer  system  (MIDS)  will  have  been  functioning  for  a  while.  A 
follow-up  study  could  ask  the  same  questions  and  examine  any  changes. 
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